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A  capture-recapture  experiment  that  successively  samples  individuals  from  some 
population  of  interest  is  the  most  popular  method  for  estimating  population  size. 
These  experiments  have  found  application  in  wildlife  ecology,  census  undercount, 
and  epidemiological  studies.  We  consider  capture-recapture  models  appropriate  for 
estimating  N  in  a  closed  population  when  the  probability  of  capture  varies  across 
both  the  N  subjects  (population  heterogeneity)  and  the  t  sampling  occasions.  We 
investigate  the  perfomance  of  mixture  models,  log-linear  models,  and  a  latent  class 
model  for  a  variety  of  dependence  structures  among  the  t  sampling  occasions.  In 
particular,  we  look  at  situations  when  population  heterogeneity  is  the  only  source 
of  dependence  among  the  t  samples,  situations  when  positive  or  negative  within- 
subject  dependencies  exist,  and  situations  when  both  sources  of  dependence  exist. 
We  demonstrate  that  two  mixed  models,  the  logistic-normal  model  and  a  logistic- 
normal  model  with  a  serial  dependence  term,  and  the  latent  class  model  experience  a 
near  nonidentifiability  problem  when  most  of  the  "captured"  subjects  are  observed  on 
only  one  sampling  occasion.  We  draw  parallels  between  this  phenomenon  and  other 

vi 


well-studied  AT-estimation  problems.  When  this  is  the  case,  the  log-linear  models  of 
homogeneous  two-factor  interaction  and  homogeneous  two-factor  interaction  plus  a 
serial  dependence  term  prove  useful  in  that  they  yield  confidence  intervals  for  N  that 
are  narrower  than  those  resulting  from  the  mixed  models  while  maintaining  close-to- 
nominal  coverage.  These  simpler  models  can  also  describe  a  wide  range  of  dependence 
structures  among  the  t  occasions  (including  negative  dependence  structures)  and  are 
easy  to  fit. 

We  present  an  alternative  mixed  model,  an  overdispersed  Poisson  model,  that 
shows  promise  in  estimating  N  when  most  subjects  are  observed  on  only  one  occasion. 
An  example  shows  that  this  model  avoids  the  nonidentifiability  problems  incurred 
by  the  other  mixed  models.  A  multivariate  logit-normal  model  is  introduced  that 
accounts  for  correlations  between  the  t  responses  by  specifying  that  the  probability 
vector  is  distributed  as  a  multivariate  normal  random  vector. 

We  also  compare  methods  for  constructing  interval  estimates  for  N.  Although  the 
bootstrap  is  probably  the  most  popular  method  in  the  capture-recapture  literature 
right  now,  we  give  several  reasons  why  profile  likelihood  intervals  are  to  be  preferred 
when  used  in  conjunction  with  the  above  models. 
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CHAPTER  1 
FORMULATION  OF  THE  CAPTURE-RECAPTURE  PROBLEM 


The  capture-recapture  (CR)  problem  is  one  of  estimating  the  size,  TV,  of  some 
population  of  interest  by  way  of  successive  sampling  and  recording  of  individuals  in 
the  population.  The  earliest  models  obtained  an  estimate  for  the  number  of  subjects 
in  the  population  under  the  restrictive  assumption  that  the  probability  of  capture 
stays  constant  for  all  occasions  and  for  all  subjects.  Researchers  quickly  realized 
that  these  assumptions,  while  mathematically  convenient  for  obtaining  a  numerical 
estimate,  were  rarely  biologically  realistic.  Thus,  in  the  last  40  years,  an  enormous 
body  of  literature  has  been  developed  to  explore  ways  to  relax  one  or  both  of  these 
assumptions. 

The  goal  of  capture-recapture  experiments  is  typically  that  of  estimating  ani- 
mal abundance  in  some  habitat,  in  which  case  the  "subjects"  are  animals  and  the 
sampling  occasions  refer  to  trappings.  Researchers,  however,  are  finding  other  areas 
of  application  for  capture-recapture  methods.  Often  called  dual-system  estimation, 
capture-recapture  methodology  has  been  used  in  census  undercount  estimation  (Alho 
et  al.,  1993;  Darroch  et  al.,  1993).  An  individual  is  "captured"  if  listed  in  the  census 
or  a  supplementary  post-enumeration  survey,  which  together  represent  the  multiple 
samples.  Captu'f>recapture  methodology  is  just  recently  finding  a  place  in  epidemi- 
ology. In  this  setting,  the  population  of  interest  is  the  set  of  individuals  with  a  certain 
condition  or  disease  and  the  sampling  occasions  correspond  to  incomplete  lists  from 
different  sources.  Wittes  (1974)  first  proposed  using  capture-recapture  methods  to 
estimate  the  size  of  an  infected  group  in  an  epidemiological  setting.    Baker  (1990) 


used  capture-recapture  methods  to  analyze  data  on  multiple  screenings  for  the  early 
detection  of  breast  cancer  in  women,  while  Regal  and  Hook  (1984,  1991)  estimated 
the  number  of  spina  bifida  cases  in  upstate  New  York.  Chao  and  Tsay  (1996a,  1996b) 
focused  on  capture-recapture  methods  applicable  exclusively  to  epidemiological  data 
and  attempted  to  estimate  the  number  of  subjects  who  contracted  the  hepititis  A 
virus  during  an  outbreak  in  Northern  Taiwan.  The  International  Society  for  Disease 
Monitoring  and  Forecasting  (1995a,b)  detailed  CR  applications  in  human  diseases 
and  called  for  future  research  in  this  area. 

Throughout  this  dissertation,  we  consider  a  general  /-sample  capture-recapture 
experiment  in  which  the  animals  are  marked  or  recorded  in  such  a  way  that  the  num- 
ber of  subjects  with  a  particular  pattern  of  being  observed  or  not  being  observed  at 
each  sampling  occasion  is  available.  These  patterns  are  often  referred  to  as  the  "cap- 
ture histories"  in  the  capture-recapture  literature.  The  data  from  such  experiments 
can  be  represented  in  a  2*  contingency  table,  formed  by  cross-classifying  the  capture 
status  of  a  subject  on  each  of  the  t  occasions.  For  instance,  if  we  denote  a  capture 
at  sampling  occasion  i  as  1  and  a  noncapture  as  0,  a  t  —  3  occasion  experiment  gives 
rise  to  the  follov  ing  23  contingency  table: 


occ.  3  =  1 
occ.  2 
1         0 


occ.  1     1 
0 


"111 

"101 

"on 

"001 

occ.  3  =  0 

occ.  2 
1  0 


occ.  1     1 
0 


"no 

"100 

"010 

"000  =? 

Thus,  nm,  for  instance,  is  the  number  of  subjects  having  capture  history  (1,1,1),  or 
captured  at  all  three  occasions.  In  this  representation  the  problem  of  estimating  N  is 
equivalent  to  estimating  n0oo>  the  number  of  subjects  unobserved  in  all  t  samples.  We 
obtain  an  estimate  of  this  unknown  quantity  through  models  which  place  assumptions 
on  the  capture  probabilities.  The  estimate  of  n0oo  is  then  the  fitted  cell  count  for  cell 
(0, 0,  0)  obtained  from  the  model. 


More  generally,  we  use  the  following  notation  throughout  this  dissertation  for  a  t 
sample  experiment.  Let  X  =  {(1, . . . ,  1), . . . ,  (0, . . . ,  0)}  denote  the  set  of  2*  possible 
capture  histories  in  lexicographic  order,  and  X  =  {(1, . . . ,  1), . . . ,  (0, . . .  ,0, 1)}  the  set 
of  observable  histories.  Let  i  =  (ii, . . . ,  it)  be  an  element  of  I,  and  let  n\  =  n^...^  be 
the  number  of  subjects  having  that  sequence.  We  let  n  =  (ni...i, . . . ,  no...o)  denote  the 
vector  of  cell  counts,  n  =  (ni...i, . . . ,  no...i)  the  vector  of  observable  cell  counts,  and 
the  scalar  n  =  Y.\^in\  the  number  of  observed  subjects  in  the  experiment. 

The  problem  of  estimating  the  unobserved  cell  count  no...o  from  a  model  fit  to  the 
observed  2*  —  1  cell  counts  is  inherently  one  of  extrapolation.  That  is,  in  "estimating" 
^o...o,  one  extrapolates  from  the  range  of  the  observed  data,  the  numbers  of  subjects 
having  1,2,...,/  captures,  to  the  number  of  subjects  with  0  captures.  One  can  think 
of  this  problem  as  similar  to  the  famous  Space  Shuttle  data  in  which  one  fits  the 
probability  of  O-ring  failure  as  a  function  of  temperature  in  the  range  of  53  to  81 
degrees,  and  then  seeks  to  predict  the  probability  of  O-ring  failure  at  31  degrees 
(Dalai  et  al,  1989;  Lavine,  1991).  Another  analogous  problem  is  that  of  low-dose 
extrapolation  (Prentice,  1976;  Brown,  1978).  In  carcinogenic  studies,  researchers  are 
often  not  able  to  employ  enough  patients  to  estimate  accurately  the  probability  of 
an  event  for  low  doses  of  a  drug.  Thus,  researchers  must  apply  larger  doses  of  the 
substance  under  question,  fit  a  model  to  the  observed  range  of  doses,  and  extrapolate 
the  fit  either  to  predict  the  effect  of  a  specific  low  dose  of  interest  or  to  determine  a 
minimum  effective  dose. 

In  extrapolation  problems  such  as  these,  different  models  that  provide  essentially 
equally  good  fits  to  the  observed  data  can  lead  to  drastically  different  predicted  values 
at  settings  outside  the  observed  range  of  covariates.  Thus,  we  see  that  population 
size  estimates  can  differ  drastically  depending  on  the  selected  model.  It  can  also 
happen  that  a  model  with  a  poor  fit  to  the  observed  data  extrapolates  to  the  settings 


of  interest  much  more  accurately  than  a  better  fitting  model.  Thus,  the  standard 
techniques  for  model  selection  based  on  goodness-of-fit  criteria  can  be  inappropriate. 

The  purpose  of  this  thesis  is  to  examine  methods  that  can  be  used  to  estimate  the 
size  of  some  population  of  interest  when  the  probability  of  capture  varies  across  both 
subjects  in  the  population  and  across  the  t  sampling  occasions.  In  Chapter  2,  we 
review  existing  models  developed  to  estimate  N  in  the  presence  of  heterogeneity  and 
discuss  the  advantages  and  disadvantages  of  each.  We  also  review  likelihood-based 
methods  for  obtaining  a  point  estimate  of  N  and  standard  techniques  of  constructing 
confidence  intervals  for  N. 

In  Chapter  3,  we  develop  a  mixed  model  approach  to  account  for  population 
heterogeneity  in  capture-recapture  studies.  We  motivate  the  logistic-normal  model, 
which  results  from  a  random-effects  approach  to  a  subject-specific  logistic  model.  We 
compare  the  performance  of  this  model  in  estimating  N  with  a  simpler  log-linear 
model  that  is  motivated  from  a  fixed-effects  approach  to  the  same  logistic  model.  We 
also  present  a  simpler  form  of  the  logistic-normal  model,  a  latent  class  model,  and 
include  this  model  in  the  comparisons.  We  demonstrate  these  methods  by  considering 
an  animal  abundance  example  resulting  from  six  trappings  of  snowshoe  hares  and  an 
epidemiologic  example  resulting  from  three  incomplete  lists  of  hepititis  A  patients 
compiled  during  a  1995  hepititis  outbreak  in  northern  Taiwan.  We  then  use  these 
examples  to  demonstrate  potential  difficulties,  in  the  form  of  flat  log-likelihoods, 
incurred  by  the  logistic-normal  model.  Finally,  Chapter  3  draws  parallels  between 
the  difficulties  incurred  in  the  mixed  model  setting  and  those  occuring  in  other  well- 
studied  AT-estimation  problems,  namely  other  capture-recapture  experiments  that 
allow  for  heterogeneity  and  the  situation  where  one  observes  k  independently  and 
identically  distributed  binomial(iV,  p)  observations  when  both  N  and  p  are  unknown. 


Chapter  4  investigates  the  usefulness  of  other  statistical  models  in  the  context  of 
capture-recapture  studies.  We  study  models  that  relax  the  logistic-normal  assump- 
tion of  local  independence.  In  particular,  for  sequential  trappings,  we  look  at  fixed- 
and  random-effect  models  allowing  for  serial  dependence,  given  an  individual.  We 
also  investigate  the  use  of  an  alternative  mixed  model  that  allows  for  overdispersion 
relative  to  the  log-linear  model  of  mutual  independence,  and  introduce  and  develop 
a  new  model,  the  multivariate  logit-normal  model,  that  postulates  a  separate  latent 
variable  for  each  occasion. 

Chapter  5  presents  the  results  of  simulation  studies  conducted  to  examine  the 
performances  of  the  models  discussed  in  Chapter  3  and  Chapter  4  in  the  capture- 
recapture  setting.  We  investigate  the  coverage  properties  and  mean  lengths  of  the 
resulting  bootstrap  and  profile  likelihood  confidence  intervals  for  N  and  the  absolute 
error  of  the  point  estimates.  These  studies  demonstrate  the  impact  that  flat  log- 
likelhoods  have  on  the  logistic-normal  model's  ability  to  accurately  estimate  N.  We 
see  that  the  logistic-normal  model  is  helpful  in  estimating  the  population  size  only 
when  the  amount  of  heterogeneity  is  small  to  moderate  and  the  probability  of  capture 
is  not  extremely  small.  Otherwise,  we  see  that  alternative  log-linear  models  are  viable 
candidates  when  mixed  models  prove  unsatisfactory. 


CHAPTER   2 
OVERVIEW  OF  THE  EXISTING  CAPTURE-RECAPTURE  LITERATURE 


Capture-recapture  methods  are  often  classified  according  to  the  strength  of  the  as- 
sumptions placed  on  the  population  of  interest.  Models  assuming  an  open  population 
that  experiences  recruitment,  in  the  form  of  birth  or  immigration,  and/or  losses,  in 
the  form  of  death  or  emigration,  incorporate  extra  parameters  for  these  phenomenon 
and  will  not  be  considered  here.  We  will  instead  concentrate  on  methods  appropriate 
when  estimating  population  size  in  closed  populations  whose  size  remains  constant 
during  a  ^-sample  capture-recapture  experiment.  In  these  models,  the  subjects  in  a 
population  of  size  N  can  be  enumerated  {1,2,  ...,N},  where  AT  is  a  parameter  to 
be  estimated.  The  assumption  of  a  closed  population  is  often  appropriate  for  studies 
conducted  over  short  periods  of  time,  say,  for  instance,  several  days. 

2.1     Existing  Models 

Darroch  (1958)  was  the  first  to  use  maximum  likelihood  analyses  to  obtain  pop- 
ulation size  estimates.  His  model  assumed  that  the  capture  probabilities  vary  across 
sampling  occasions,  but  are  the  same  for  every  subject  in  the  population.  This  fits 
into  the  Mt  class  of  models  within  the  hierarchy  of  models  of  Otis  et  al.  (1978) 


M0,  Mt,  Mh,  Mb,  Mth,  Mtb,  Mhb,  Mm, 


where  t  denotes  variation  of  capture  probabilities  across  time,  h  denotes  variation 
of  capture  probabilities  across  subjects  (/i=heterogeneous  population),  and  b  denotes 
variation  of  capture  probabilities  according  to  a  behavioral  response.     Behavioral 


response  refers  to  the  phenomenon  of  the  capture  probability  changing  once  an  animal 
is  captured  either  in  the  form  of  trap  "avoidance"  or  trap  "dependence."  M0,  the 
simplest  model,  assumes  constant  capture  probability  for  all  animals  on  all  sampling 
occasions  and  is  rarely  realistic. 

Although  models  are  now  available  for  the  entire  hierarchy,  models  allowing  cap- 
ture probabilities  to  vary  among  individuals  (i.e.  having  the  subscript  h)  have  proven 
to  be  problematic.  In  this  chapter  we  will  review  in  detail  existing  models  that  ac- 
count for  heterogeneity.  The  earliest  attempts  to  consider  heterogeneity  specified  a 
heterogeneous  population  as  an  assumption  violation  to  simpler  models,  for  instance 
M0,  Mb,  or  Mt,  and  tried  to  construct  estimators  that  were  robust  to  this  violation. 
Fienberg  (1972)  proposed  using  a  log-linear  model  that  fit  the  2*  — 1  contingency  table 
well.  Cormack  (1989),  however,  noted  that  although  means  of  checking  for  subject 
heterogeneity  are  available  when  using  standard  log-linear  models,  these  models  do 
not  provide  reliable  estimates  when  this  is  the  case.  Nanthan  Mantel,  pioneer  of  the 
use  of  stratified  contingency  tables,  stated  (Gail,  1997), 

The  issue  was  to  estimate  the  population  size.  Fienberg's  idea  was  to 
assume  that  you  were  in  a  complex  contingency  table  with  one  missing 
cell  entry.  However,  his  method  assumed  that  all  animals  came  from  this 
same  complex  contingency  table.  That  was  one  thing  that  I  would  have 
disagreed  with.  Maybe  the  risks  were  not  really  homogeneous  from  animal 
to  animal. 

The  two  most  popular  estimators  within  the  Mh  class  are  the  Burnham-Overton 
(1978)  and  Chao  (1987,  1989)  estimators.  Burnham  and  Overton  (1978)  were  the  first 
to  estimate  N  using  heterogeneous  capture-recapture  models.  Both  of  these  models 
assume  that  the  capture  probabilities  ps,  s  =  1, . . . ,  N,  are  randomly  distributed  ac- 
cording to  an  unspecified  distribution  F.  Most  recently,  Norris  and  Pollock  (1996) 
conducted  nonparametric  ML  estimation  (NPML)  of  the  pair  (TV,  F)  via  an  EM  al- 
gorithm under  both  Mh  and  Mbh  assumptions. 
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This  is  by  no  means  an  exhaustive  list  of  all  heterogeneity  models  in  the  enormous 
capture-recapture  literature.  Other  models  within  this  class  were  proposed  by  Pollock 
and  Otto  (1983),  Smith  and  Van  Belle  (1984),  and  Lee  and  Chao  (1994).  In  this 
section,  however,  we  focus  on  the  models  in  the  preceding  paragraph  because  log- 
linear  models  are  the  simplest  to  implement,  the  Burnham-Overton  and  Chao  models 
are  the  most  widely  used  heterogeneity  models,  and  the  NPML  estimator  is  the 
most  recent.  These  models  also  introduce  the  themes  that  will  become  evident  in 
Chapters  3-5;  that  is,  these  models  demonstrate  difficulties  inherent  in  the  problem 
of  AT-estimation  when  heterogeneity  is  present  and  the  trade-off  of  narrow  confidence 
intervals  versus  attained  confidence. 

2.1.1     Log-linear  Models 

An  obvious  class  of  models  to  model  the  2*  —  1  counts  in  the  contingency  table 
is  the  class  of  log-linear  models.  As  noted  earlier,  the  use  of  these  models  in  the 
capture-recapture  setting  was  first  developed  by  Fienberg  (1972)  and  reviewed  by 
Cormack  (1989). 

These  models  assume  that  the  cell  counts  in  the  2*  table  are  either  Poisson  or 
multinomial  random  variables.  Since  independent  Poisson  random  variables  are  dis- 
tributed as  multinomial  when  conditioned  on  their  sum,  both  of  these  assumptions 
yield  identical  inferences.  Log-linear  models  relate  the  expectations  of  these  counts, 
{/jj},  to  a  vector  of  unknown  parameters,  (3,  through  the  log  transformation, 

log(/x)  =  X/3, 

where  \x  is  the  vector  of  cell  means  in  lexiographic  order  and  X  is  a  known  covariate 
matrix.  We  estimate  the  unknown  parameter  vector  (3  through  maximum  likelihood. 
Since  Poisson  log-linear  models  are  exponential  family  models  and  the  log  link  is  the 
canonical  link,  the  likelihood  equations  take  the  form  of  equating  the  expected  value  of 


the  sufficient  statistics  to  their  observed  values.  Fienberg  (1972)  and  Cormack  (1989) 
selected  an  appropriate  model  within  the  hierarchy  of  log-linear  models  based  on 
usual  goodness-of-fit  criteria,  either  the  Pearson  chi-squared  statistic  or  the  residual 
deviance. 

The  simplest  way  to  obtain  an  TV-estimate  from  a  given  log-linear  model  is  to  fit 
the  model  to  the  2*  —  1  observed  counts  conditional  on  the  number  of  subjects,  n, 
observed  in  the  experiment.  We  then  use  the  model  to  predict  the  content  of  the 
unobservable  cell.  We  demonstrate  this  procedure  in  the  simple  two-sample  case, 
for  which  the  model  specifying  that  the  capture  status  at  occasion  is  independent 
of  capture  status  at  occasion  one  produces  a  closed-form  estimator.  Consider  the 
following  2x2  table: 

occ.  2 
_1       0 
occ.  1     1 
0 

Letting  frj  =  E(riij),  i,j  =  0,1,  denote  the  expected  value  of  the  ijth  cell  count,  the 
maximum  likelihood  estimates  of  the  {/i^}  conditional  on  n  =  nio  +  noi+nn  are  just 
the  corresponding  {n„}.  Also,  the  independence  model  requires 

MioMoi 

so  that 

_  AioAoi       "io«oi 
/%)  —  — : — • 

This  estimate  is  the  traditional  Lincoln  index  (1930)  used  to  estimate  N. 

Log-linear  modelling  of  capture-recapture  data  has  both  advantages  and  disad- 
vantages. One  advantage  is  that,  unlike  the  Mh  models  discussed  in  the  next  section, 
capture  probabilities  are  allowed  to  vary  across  sampling  occasions.    Also,  one  can 


nn 

nio 

n0i 

- 
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specify  dependencies  between  sampling  occasions  in  the  form  of  interactions.  The 
only  requirement  on  the  form  of  the  model  in  order  to  obtain  an  TV-estimate  is  that 
the  /-order  interaction  is  zero.  Otherwise,  the  model  is  saturated  for  the  unknown  cell 
count,  and  any  value  of  that  count  is  consistent  with  the  model.  Thus,  the  saturated 
model  provides  no  information  on  the  population  size. 

A  third  advantage  of  the  log-linear  models  is  the  ease  with  which  these  models 
can  be  implemented.  Cormack  (1989,  1990),  Agresti  (1994)  and  others  showed  that 
one  can  fit  standard  log-linear  models  to  capture-recapture  data  using  GLIM  (Francis 
et  al.  (1993)).  One  simply  specifies  the  weight  of  the  missing  cell  count  to  be  zero, 
producing  TV-estimate  N  =  n  4-  /io...o-  This  estimate  corresponds  to  an  estimate  of  TV 
conditional  on  n.  We  discuss  this  estimation  procedure  in  Section  2.2.1. 

The  main  disadvantage  of  log-linear  modelling  is  the  inability  to  model  heterogene- 
ity within  the  population.  Cormack  (1989)  proposed  ways  to  diagnose  heterogeneity 
when  fitting  these  models.  He  suggested  examining  the  residual  deviance,  examining 
the  pattern  of  standardized  residuals  based  on  the  number  of  individuals  observed 
and  predicted  to  have  been  captured  k  times,  k  =  1, ...,£,  He  suggested  that  plots 
exhibiting  a  concave  shape  exhibit  heterogeneity,  suggesting  that  the  given  log-linear 
model  is  inadequate  for  the  data.  He  demonstrated  with  a  set  of  data  based  on  six 
trappings  of  snowshoe  hares,  which  we  will  analyze  in  detail  in  Chapter  3. 

In  the  standard  setting  for  log-linear  models,  that  of  complete  contingency  ta- 
bles where  all  cell  counts  are  observed,  parsimonous  log-linear  models  yield  smaller 
standard  errors  for  estimated  parameters.  Thus,  the  standard  practice  is  to  base 
inferences  on  a  simpler  model  that  fits  reasonably  well  since  the  mean  squared  errors 
of  the  estimates  for  that  model  can  be  much  smaller  than  those  for  a  more  com- 
plex model,  even  if  the  simpler  model  holds  only  approximately.  In  the  context  of 
TV-estimation  in  capture-recapture  models,  the  magnitude  of  the  standard  error  for 
TV  also  increases  for  more  complex  models.    As  noted  in  Chapter  1,  however,  the 
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traditional  goodness-of-fit  tests  for  extrapolatory  problems  do  not  necessarily  give  a 
good  indication  of  the  model  fit  to  the  response  outside  the  observed  range  of  data. 
Thus,  simpler  models  that  yield  smaller  standard  errors  and  narrower  confidence 
intervals  can  result  in  overly  optimistic  confidence.  This  was  noted  by  Regal  and 
Hook  (1991)  and  Agresti  (1994)  in  the  capture- recapture  setting,  and  Prentice  (1976) 
in  the  low-dose  extrapolation  setting.  Thus,  Prentice  (1976)  and  Regal  and  Hook 
(1991)  both  suggest  the  opposite  of  standard  practice:  unless  outside  considerations 
warrant  the  use  of  a  simple  model,  one  should  use  the  more  complex  model  to  obtain 
wider  confidence  intervals  that  achieve  higher  actual  coverage.  We  will  examine  the 
trade-off  between  narrow,  "informative"  confidence  intervals  versus  attaining  nominal 
confidence  in  Chapter  5. 

We  introduce  a  variety  of  models  that  allow  for  heterogeneity  in  Chapters  3  and 
4,  and  compare  their  performance  in  estimating  TV  through  simulation  in  Chapter  5. 
First,  however,  we  review  in  detail  previous  attempts  to  model  heterogeneity  in  the 
population. 

2.1.2     Models  Allowing  for  Heterogeneous  Population 

As  noted  by  Cormack  (1989),  the  main  problem  in  using  log-linear  models  in 
capture-recapture  experiments  is  the  constraint  that  the  capture  probability  is  the 
same  for  all  N  subjects  in  the  population.  The  assumption  of  heterogeneous  capture 
probabilities  has  proven  to  be  most  problematic  in  the  capture-recapture  setting.  It 
has  long  been  recognized  that  ignoring  heterogeneity  when  it  is  present  results  in  se- 
vere underestimation  of  the  population  size  (Burnham,  1972;  Burnham  and  Overton, 
1978;  Chao,  1987,  1989;  and  references  therein).  On  the  other  hand,  several  models 
developed  to  account  for  heterogeneity  either  (a)  yield  confidence  intervals  for  N  that 
have  extremely  poor  coverage  or  (b)  yield  extremely  wide  confidence  intervals  that 
provide  little  or  no  practical  information  on  the  population  size.  This  section  presents 
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a  summary  of  the  models  developed  to  account  for  heterogeneity  in  the  population 
with  respect  to  capturability. 

Burnham's  Beta-Binomial  Model 

Under  the  M/,  assumptions,  the  number  of  captures  for  subject  s  in  the  population 
is  a  binomial  random  variable  with  t  trials  and  success  probability  ps,  where  ps  is  the 
probability  of  capture  of  subject  s.  A  natural  strategy  in  modelling  heterogeneity  is 
to  specify  that  the  individual  capture  probabilities  {ps}  are  random  variables  with 
some  known  parametric  form.  One  can  then  average  across  this  mixing  distribution  to 
obtain  expressions  for  the  probability  of  capture  of  a  subject  selected  at  random  from 
the  population.  Since  the  capture  counts  for  each  observed  individual  are  binomial, 
a  natural  candidate  for  the  form  of  the  mixing  distribution  is  the  congugate  beta 
distribution.  Thus,  ps  ~  Beta(a,  6),  where  a  and  b  are  unknown  parameters.  This 
assumption  results  in  the  common  beta-binomial  model  (Morgan,  1992). 

The  marginal  log-likelihood  for  this  model  is  obtained  by  integrating  over  the 
random  beta  mixing  distribution.  This  marginal  log-likelihood  is  then  maximized 
over  a,  6,  and  N  to  obtain  a  maximum  likelihood  estimate  for  the  population  size. 
Burnham  (1972)  rigorously  developed  this  model  in  his  dissertation.  Unfortunately, 
he  concluded  that  this  model  was  unsatisfactory  for  estimating  the  population  size 
because  it  yields  extremely  flat  log-likelihoods  with  respect  to  the  unknown  parameter 
N.  These  flat  profile  log-likelihood  surfaces  are  a  result  of  a  near-nonidentifiability 
problem  that  occurs  when  both  the  parameters  of  the  mixing  distribution  and  the 
population  size  N  are  left  completely  unspecified.  These  flat  surfaces  result  in  nearly 
arbitrary  point  estimates  for  N  and  extremely  wide  confidence  intervals  that  provide 
little  or  no  practical  information  on  N.  We  look  at  this  problem  in  more  detail  in  the 
context  of  logistic-normal  models  in  Chapter  3. 
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Burnham  and  Overton's  Solution  -  the  Jackknife 

Burnham  and  Overton's  (1978)  solution  to  the  near  nonidentifiability  problem 
encountered  in  the  beta-binomial  model  is  a  jackknife  estimate.  This  population  size 
estimate  takes  a  naive  estimate  of  N,  the  total  number  of  subjects  seen  in  the  exper- 
iment, and  attempts  to  improve  this  estimate  through  a  bias  correction  procedure, 
the  jackknife. 

Specifically,  the  jackknife  is  a  leave-one-out  algorithm  that  estimates  the  bias  of 
an  estimator  of  interest.  Suppose  we  wish  to  estimate  an  unknown  parameter,  9, 
indexing  an  unknown  distribution.  Let  x  =  (x\, . .  .  ,£„)  be  a  random  sample  of  size 
n  from  this  distribution,  and  suppose  that  we  wish  to  estimate  9  with  the  statistic 
9  =  #(x).  One  performs  the  jackknife  by  computing  9u\  =  0(x_j),  where  x_;  is  the 
sample  of  size  n  —  1  formed  by  deleting  the  ith  observation.  If  #g  =  ^Z)"=1%), 
then  the  jackknife  estimate  of  bias  is  B  =  (n  —  1  )(#(.)  —  9).  This  estimate  yields  the 
bias-corrected  estimate  9  =  9  —  B.  Under  the  assumption  that 

n      nz 

where  the  {a*}  are  constants,  the  jackknife  technique  reduces  the  bias  from  order  1/n 
for  9  to  order  1/n2  for  9  (Efron  1982).  One  can  reduce  the  order  of  the  bias  further 
by  deleting  d  observations  at  a  time,  known  as  the  delete-d  jackknife. 

Burnham  (1972)  and  Burnham  and  Overton  (1978)  applied  the  jackknife  to  the 

capture-recapture  setting  by  considering  9  —  nt,  the  total  number  of  subjects  observed 
after  /.  samples,  as  a  biased  estimate  for  the  unknown  parameter  9  =  N.  The  authors 
assume  that 


E(nt)=N  +  ^  +  %  + 


ai      as 

t       f2 
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since  the  bias  decreases  as  more  samples  are  taken.  The  authors  performed  the 
jackknife  by  computing  the  t  statistics  {n^-\)t}  by  pretending  that  the  ith  sample  was 
not  recorded.  The  resulting  bias-corrected  estimate  has  closed  form  since  the  n^t-i)i 
depend  only  on  the  original  estimate  nt  and  the  number  of  individuals  who  were 
observed  exclusively  on  occasion  i.  The  authors  also  proposed  higher-order  jackknife 
estimates  obtained  by  deleting  more  than  one  occasion  at  a  time  and  proposed  a  test 
to  determine  which  estimate  should  be  used  to  estimate  the  population  size. 

These  jackknife  estimators  also  have  advantages  and  disadvantages.  The  estimates 
are  easy  to  compute  since  they  can  be  expressed  as  a  linear  combination,  Y%=\  c%fi, 
with  known  coefficients  {q}  of  the  number  of  subjects  {/j}  observed  on  exactly  i 
different  sampling  occasions,  which  are  the  minimal  sufficient  statistics  for  the  Mh 
model.  As  a  result,  closed-form  expressions  of  the  asymptotic  variances  for  the  es- 
timates exist.  Also,  through  simulation  results,  Burnham  (1972)  demonstrated  that 
the  asymptotic  confidence  intervals  obtained  from  these  estimates  tend  to  have  ac- 
tual coverage  close  to  the  nominal  level  when  t  is  large  (t  >  10)  for  a  wide  range  of 
assumed  heterogeneity  distributions. 

The  main  disadvantage  of  the  jackknife  estimators  is  the  extremely  poor  confidence 
interval  coverage  when  the  number  of  sampling  occasions  are  small.  Chao's  (1987) 
and  our  simulations  show  that  for  t  <  5,  the  true  coverages  can  be  as  low  as  zero 
in  the  presence  of  moderate  heterogeneity.  Also,  for  some  models,  it  is  possible 
to  show  analytically  that  the  bias  of  nt  is  not  expressible  as  a  power  series  in  t 
(Cormack,  1989).  Specifically,  model  M0,  discussed  at  the  beginning  of  this  section, 
and  all  finite  mixture  distributions  for  a  subject's  capture  probability  p,  do  not  satisfy 
this  assumption.  Thus,  in  these  cases,  theory  has  shown  that  these  bias-corrected 
estimates  do  not  necessarily  have  smaller  bias  than  the  original  estimator  nt. 
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Chao's  Alternatives  to  the  Jackknife 

The  poor  performance  of  Burnham  and  Overton's  jackknife  estimates  for  a  small 
number  of  sampling  occasions  led  Chao  (1987,  1989)  to  develop  an  alternative  esti- 
mator based  on  the  method  of  moments.  This  estimator  was  also  motivated  assuming 
/,  is  large  and  the  mean  probability  of  capture  is  small,  but  simulation  (Chao,  1987) 
demonstrated  that  this  alternative  yields  much  higher  confidence  interval  coverage 
when  t  is  small.  Instead  of  basing  the  estimator  on  all  known  capture  frequencies, 
{/i},  Chao  developed  an  estimator  based  only  on  /i,/2-  Chao  pointed  out  the  intu- 
itive appeal  of  this  estimator  since  animals  remaining  unobserved  after  t  samples  (i.e. 
those  animals  in  capture  frequency  /o)  are  thought  to  be  most  like  those  observed  on 
a  small  number  of  occasions. 

Chao  assumed  that  the  individual  capture  probability  for  individual  s,  ps,  is  dis- 
tributed according  to  some  unspecified  distribution  function  F.  This  yields  expected 
values 


?(/i)  =  ^jfVMp<(l-p)*-«dF(p) 


E(fi)  =  NjQ   I  Jlp*(l-p)*-'dF(p),      8  =  0,1,...,*. 

Using  a  Poisson  approximation  to  the  binomial  density  when  t  is  large  and  p  is  small 
and  Jensen's  inequality,  Chao  obtained  the  inequality 

F(n>  [WO]2 

which  leads  to  the  moment  estimate, 

/i2 


N  >n  + 


(2/2) 


as  a  lower  bound  of  the  population  size. 

Without  being  any  more  difficult  to  compute,  this  estimator  and  asymptotic  con- 
fidence interval  perform  much  better  than  the  Burnham-Overton  estimator  for  a  wide 
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range  of  assumed  mixing  distributions.  As  Chao  points  out,  this  estimate  will  not 
perform  well  when  the  mean  probability  of  capture  is  moderate  to  large,  since  informa- 
tion based  on  subjects  captured  on  more  than  two  occasions  (i.e.  counts  (/s,/4,  •  •  •)) 
is  ignored. 

Nonparametric  MLE 

Norris  and  Pollock  (1996)  developed  models  in  the  classes  M^  and  M^  that  non- 
parametrically  estimate  the  random  distribution  assumed  for  the  population  hetero- 
geneity. This  work  generalized  Burnham's  beta-binomial  model,  which  assumed  that 
the  subject  capture  probabilities  ps  are  distributed  as  Beta(a,  b)  random  variables, 
by  leaving  this  mixing  distribution,  F,  unspecified  and  estimating  it  via  maximum 
likelihood.  For  a  given  candidate  value  for  TV,  the  authors  used  existing  algorithms  for 
finding  the  nonparametric  maximum  likelihood  estimate  for  F.  After  doing  this  for 
many  plausible  N  values,  the  authors  took  as  the  nonparametric  maximum  likelihood 
estimate  (NPMLE)  of  N  the  value  for  which  the  pair  (TV,  F)  yielded  the  maximum 
log-likelihood  among  all  those  candidate  values  of  TV  considered. 

These  authors  avoided  the  flat  log-likelihood  difficulties  by  placing  restrictions  on 
both  the  possible  size  of  the  population  and  the  size  of  the  probability  of  capture. 
In  order  to  use  Norris  and  Pollock's  estimators,  one  must  place  an  upper  bound  on 
the  size  of  the  population,  as  well  as  a  lower  bound  on  the  probability  of  capture. 
Norris  and  Pollock  suggested  that  if  the  NPMLE  of  N  is  the  pre-set  upper  bound, 
one  should  not  use  this  estimator. 

2.1.3     Models  Allowing  for  Heterogeneous  Population  and  Variable  Sampling  Effort 

There  are  relatively  few  members  in  the  class  of  models  allowing  for  both  time 
and  heterogeneity  effects,  denoted  by  Mth.  Lloyd  and  Yip  (1991)  proposed  martingale 
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estimating  equations  as  a  unifying  framework  for  capture-recapture  inference  under 
which  simultaneous  occasion  and  subjects  effects  could  be  included.  Chao,  Lee,  and 
Jeng  (1992)  proposed  a  nonparametric  method  of  estimation  for  this  model.  We 
review  three  such  models  here.  We  first  consider  Sanathanan's  (1974)  "generalized" 
model,  since  it  is  the  mixed  logistic-normal  model  that  we  study  in  Chapter  3.  We  also 
detail  the  two  most  recently  developed  models  that  take  into  account  heterogeneity 
and  occasion  effects,  the  log-linear  model  of  homogeneous  2-factor  interaction,  de- 
veloped by  Darroch  et  al.  (1993)  and  Agresti  (1994),  sometimes  referred  to  as  the 
partial  quasi-symmetry  model,  and  Chao  and  Tsay's  (1996a,  1996b)  estimator  based 
on  the  notion  of  sample  coverage. 

Sanathanan's  'Generalized'  Model 

Sanathanan  (1974)  was  the  first  to  consider  a  capture-recapture  model  that  al- 
lowed the  probability  of  capture  to  vary  across  both  sampling  occasions  and  among 
the  subjects  in  the  population.  Sanathanan  considered  a  two-step  estimation  scheme 
to  the  logistic-normal  model  discussed  in  Chapter  3  to  obtain  cell  probability  esti- 
mates conditional  on  the  total  observed  number  of  subjects  in  the  experiment.  The 
author  considered  the  impact  of  the  assumption  of  different  random-effects  distribu- 
tions when  only  three  samples  were  taken.  Sanathanan,  however,  does  not  report  any 
problems  with  this  model  in  terms  of  flat  log-likelihoods,  arbitrary  point  estimates, 
or  extremely  wide  confidence  intervals. 

Homogeneous  Two-Factor  Interaction  Model 

Darroch  et  al.  (1993)  and  Agresti  (1994)  motivated  the  simple  log-linear  model  of 
homogeneous  two-factor  interaction  from  a  fixed-effects  approach  to  a  subject-specific 
logistic  model.    Specifically,  if  //;  =  /x,-j...je  =  E(njj...j()  is  the  mean  of  the  cell  count 
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associated  with  capture  history  (ix , . . . ,  it)  in  the  2*  table  formed  by  cross-classifying 
capture  status  at  each  of  the  t  occasions,  then  this  model  is 

log(/v..iJ  =n+  ftii  +  • . .  +  M  +  (     'J  $i  )  A> 

where  we  define  (    ,    J  =  0  if  a  <  b.   The  t  main-effect  occasion  parameters  model 

the  variation  in  the  capture  probabilities  across  the  t  sampling  occasions,  while  the 
extra  term  A  accounts  for  subject  heterogeneity. 

We  will  consider  this  model  in  detail  in  Chapter  3  when  we  derive  both  the  fixed 
and  random  effect  approaches  to  the  subject-specific  logistic  model.  This  model  is 
also  included  in  the  simulation  study  of  Chapter  5,  and  the  results  suggest  that  this 
model  is  useful  when  substantial  population  heterogeneity  is  present. 

Chao's  Sample  Coverage  Estimator 

Chao  and  Tsay  (1996a,  1996b)  estimated  N  when  both  occasion  and  subject 

effects  are  present  through  the  notion  of  sample  coverage.  Consider  a  t  =  3  sample 

experiment.  Let  YSj  =  1  if  subject  s  is  captured  on  occasion  j  and  0  otherwise,  fij  = 

TV-1  Y^s=i  E(YSj)  be  the  average  probability  of  capture  on  occasion  j,  j  =  1, ...  ,3, 

and 

1    N 
7<j  =  T7  22  E  [(F«  -  tM)  (Yv  ~  Mi)]  /(tMVj) 

and 

1    N 

7123  =  T7  2J  E  t(y*l  -  A*l)  {Ys2  ~  fr)  {Ys3  ~  /i3)]  /(HllitfMl) 

measure  the  degree  of  dependence  between  the  occasions.  Chao  and  Tsay  used  the 
connection  between  the  number  of  subjects  unseen  and  the  conditional  probability 
of  finding  an  undiscovered  one  if  an  additional  sample  is  collected.    They  defined 
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sample  coverage,  C,  as  just  one  minus  this  conditional  probability,  and  then  estimated 
N  through  its  relationship  with  C  and  the  two  and  three-way  associations,  7  = 
(712,713,723,7123),  between  the  sampling  occasions. 

Specifically,  the  authors  defined  sample  coverage  as  follows.  Let  /(•)  denote  the 
indicator  function.  Assuming  the  first  two  samples  are  fixed,  the  probability  that  an 
additional  subject  is  discovered  on  the  third  occasion  is 

Ef=1  PP*  =  l) 

Since  epidemiological  applications  are  the  main  focus  of  these  papers  so  that  no 
ordering  exists  for  the  sampling  occasions,  the  analogous  quantities 

p       E?=iP(Ysl  =  l)I[Ys2  =  0,Ys3  =  0] 

Ef=1p(ysl  =  i) 

when  fixing  samples  two  and  three,  and 

p     s£iP(r.2  =  i)/[r.i  =  o,r.3  =  o] 

when  fixing  samples  one  and  three,  are  also  relevant.  Thus, 

C*  =  Pl+P2  +  P3  (2.1) 

is  defined  as  the  average  probability  of  finding  a  new  subject  in  any  chosen  additional 
sample,  and  the  sample  coverage  is  then  defined  as  C  =  1  —  C*. 

Let  n+j2j3,  ni1+ig,  njjj2+,  riil++,  n+i2+,  n++is  be  marginal  counts  obtained  by  sum- 
ming the  observed  cell  counts,  n,  over  the  samples  denoted  by  "+"  in  the  subscript. 
Chao  and  Tsay  argued  that  a  reasonable  estimate  for  Pj,  j  =  \,  2, 3,  is  the  number  of 
subjects  captured  on  occasion  j  only  divided  by  the  total  number  of  subjects  captured 
on  occasion  j,  leading  to  sample  coverage  estimate 

A  _  ■,  _  1   (  n100     ,     n010      ,     ^001  \ 


3  \n-[++      n+i+      n++i 
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Then,  claiming  that  identities 


and 


N  =  ETC)  +  SE(Ci  ^ni+0  +  n+10^12  +  E(n™+  +  "+oi)7i3 


+E(n0l+  +  n0+1)723]  +  j^-y  (2.2) 

^  =  N^,„)%,t) "  '•  (2'3) 

■*  =  nf<  e{1f!}  >  -  »■  <2-4> 


E("+n)  .  ,,  ., 

723  Vij^,) "  ( 5) 


hold,  where 


6   \s=\  s-1  s=\  ) 

is  the  average  of  the  distinct  total  and  R  is  a  remainder  term  involving  7,  they 
obtained  an  N-estimate  as  follows.  Set  72  =  0  in  identity  (2.2)  by  assuming  that 
the  three-way  association,  7123,  between  occasions  is  a  linear  function  of  (/ii,/42,  ^3) 
and  the  two-way  associations.  Then  solve  the  equation  that  results  by  replacing  all 
expectations  in  (2.3),  (2.4),  and  (2.5)  by  their  observed  values  and  substituting  the 

resulting  (712,713,723),  along  with  D  for  E(D)  and  C  for  E(C),  into  identity  (2.2). 
This  results  in  the  JV-estimate 

fi.  n+n  +ni+x  +n+11  ^ 


1-i 

3C 


3C 

-1 


(n1+0  +  n+io)nu+       (n10+  +  n+0i)n1+i   |   (n0+i  +  n+0i)n+n 


ni++n+i+  ni++n++i  n+i+n++i 
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Since  this  TV-estimate  contains  C  in  its  denominator,  Chao  and  Tsay  noted  that 
TV  can  be  unstable  for  small  sample  coverage.  We  have  found  that  this  instability, 
in  fact,  can  take  the  form  of  nonsensical  negative  estimates  of  the  population  size. 
Even  if  the  observed  data  prove  to  be  "stable"  in  Chao  and  Tsay's  terms,  bootstrap 
replicates  (see  Section  2.3.2)  used  to  obtain  estimated  variances  for  N  and  confidence 
intervals  for  TV  can  have  this  undesireable  behavior.  Thus,  this  poor  behavior  is  the 
main  disadvantage  of  this  sample  coverage  estimator. 

Chao  and  Tsay  proposed  an  alternative,  one-step  estimator,  N\,  to  be  used  when 
TV  proves  unstable.  This  iterative  estimator  is  constructed  by  substituting  the  TV- 
estimate  that  assumes  no  dependencies  between  occasions,  TV  =  -5,  into  equations 
(2.3),  (2.4),  and  (2.5),  substituting  the  resulting  two-way  association  estimates  into 
(2.2)  to  obtain  new  estimate  TV',  and  then  repeating  this  process  using  TV'  to  obtain 

alternative  estimate  N-[. 

The  main  advantage  of  these  estimators  over  the  ML  estimates  we  will  consider 
in  Chapters  3  and  4  is  that  they  can  be  expressed  in  closed-form  so  that  one  can 
compute  a  point  estimate  and  bootstrap  confidence  intervals  for  TV  (see  Section  2.3.2) 
quickly.  Also,  these  estimators  allow  for  both  sources  of  dependence  between  oc- 
casions: within-subject  dependence  and  population  heterogeneity.  We  will  consider 
both  sources  of  dependence  in  Chapter  4.  The  major  disadvantages  of  TV  are  the 
possible  nonsensical  TV-estimates  and  the  lack  of  a  model  generating  this  this  form 
of  estimate.  Nx  remedies  the  instability  of  TV,  but  Chao  and  Tsay's  simulations  sug- 
gested that  this  estimator  yields  overly  optimistic  nonparametric  bootstrap  percentile 
confidence  intervals  (e.g.  56%  actual  coverage  for  a  95%  confidence  interval)  when 
the  true  model  is  a  continuous  mixture  model.  Our  simulations  have  shown  that  this 
actual  coverage  figure  can  drop  to  20%  in  some  settings.  We  focus  on  the  issue  of 
narrow  confidence  intervals  versus  attained  nominal  confidence  in  Chapter  5. 
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2.2     Maximum  Likelihood  Estimation  of  N 


In  this  section,  we  review  three  methods  for  obtaining  point  estimates  for  N 
from  a  model  applied  to  the  2*  table  with  unknown  cell  count  n0...o-  In  subsequent 
discussions,  we  refer  to  the  table  with  all  2*  cell  counts  known  as  the  complete  table 
and  the  2*  —  1  observed  counts  as  the  incomplete  table. 

2.2.1     Conditional  on  the  Number  of  Observed  Subjects 

Sanathanan  (1972)  outlined  an  approach  to  the  estimation  of  TV  conditional  on  the 
total  number  of  observed  subjects  for  any  general  model  indexed  by  parameter  vector 
0.  For  a  model  indexed  by  0,  the  likelihood  of  (TV,  0)  given  n  =  (ni...i, . . . ,  no.. a)  is 

m  «*>-  »,„,! . . .  fZLw  -  »v  ffi-iW"'"'  ■  •  ■""  w4*^"-- 

Sanathanan,  using  the  sufficiency  of  n  for  TV,  factors  L  into  two  components: 

L{N,0;n)  =  Li(0;n|n)L2(W,0;n) 

where 

£1(0;n|n)=  ,  "'  /1...1(g)"1-1  ■■■<..i(0)"°-1 

"1...1!  •  •  -no...\i 


and 


AH 


with 


A 


Since  La  is  free  of  N  and  is  a  function  only  of  the  unknown  parameters  0,  one  obtains 
estimates  0C  from  the  incomplete  table  by  conditioning  on  n  and  maximizing  L\  with 
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respect  to  6.  One  then  maximizes  L2(N,  0C;  n)  with  respect  to  N,  yielding 


Nc  = 


n 


1  -  7TO...o(<?c). 


(2.6) 


where  [x]  denotes  the  greatest  integer  less  than  or  equal  to  x.  Sanathanan  showed 
that  Nc  has  the  same  asymptotic  normal  distribution  as  N,  the  value  of  N  for  which 
(N,  9)  yields  the  overall  maximum  of  L,  as  the  true  population  size  goes  to  infinity. 
Let  /}0...o  be  the  fitted  value  for  the  unknown  cell  count  obtained  by  conditioning  on 
n  and  fitting  a  given  model  to  the  incomplete  table.  In  addition,  let  n0...o  be  potential 
values  for  no...o,  with  no...o  >  0.  For  a  given  observed  incomplete  table,  let  G2(no...o) 
be  the  deviance  for  the  model  applied  to  the  complete  table  formed  by  assuming  the 
unobserved  cell  count  is  no...o-  This  conditional  (on  n)  estimation  procedure  selects 
the  value  /io...o  that  minimizes  G2(no...o)  for  that  complete  table.  That  is, 

G2(£o...o)=      inf     G2(n0...o).  (2.7) 

rio...o€#+ 

This  estimate  //0...o  is  the  value  that  produces  a  complete  table  whose  fitted  values 
from  the  model  under  consideration  satisfy  n  =  n. 

Fienberg  (1972)  applied  this  approach  to  log-linear  modelling  of  capture-recapture 
data,  calling  it  an  extension  of  the  estimated  parameters  to  the  missing  cell  count. 
Fienberg  demonstrated  testing  the  fit  of  the  model  to  the  data  with  the  deviance 
applied  to  the  incomplete  table, 


G2  =  2Enilog(^7),  (2.8) 


yet  cautions  against  the  use  of  these  methods  for  accurate  estimation  of  N.  Fienberg 
likened  the  capture- recapture  problem  to  fitting  a  regression  line  of  y  on  x,  say,  for 
x  >  0,  and  then  using  the  fit  of  this  line  to  predict  y  at  x  =  0.  This  alludes  to 
the  extrapolatory  nature  of  the  problem  as  discussed  in  Chapter  1.   Our  experience 
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has  been  that  the  goodness-of-fit  criterion  applied  to  the  observed  data  does  not 
necessarily  indicate  an  accurate  iV-estimate.  We  will  demonstrate  this  phenomenon 
in  Chapter  3. 

The  advantage  of  these  conditional  methods  is  the  computational  ease  of  obtaining 
Nc,  especially  when  using  standard  log-linear  models  (see  Section  2.1.1).  Cormack 
(1989,  1990),  Agresti  (1994),  and  others  showed  the  ease  of  fitting  standard  log-linear 
models  to  capture- recapture  data  using  GLIM  by  simply  specifying  the  weight  of  the 
missing  cell  count  to  be  zero,  producing  iV-estimate  N  =  n  +  /2o...o-  Baker  (1990) 
described  an  EM  algorithm  approach  to  obtaining  these  conditional  estimates.  Using 
a  starting  guess  for  the  missing  cell  count,  one  performs  the  M-step  of  fitting  a  chosen 
model  to  the  complete  table  and  the  E-step  of  taking  II  to  be  the  observed  values  and 
no...o  to  be  the  fitted  value  from  the  previous  M-step  fit.  In  his  comment  to  Baker, 
Cormack  (1990)  noted  that  this  iterative  approach  obtains  the  same  estimate  Nc  as 
the  GLIM  approach  and  is  unnecessary. 

2.2.2     Search  over  N 

Alternatively,  one  can  search  for  the  overall  maximum  of  L  with  respect  to  (N,  0) 
by  maximizing 

LW9;n)    =    „,„,! .  ..Zw  -  „)l  "^  W"  •  •  •'"  W"-H«>*- 

with  respect  to  0  for  a  fixed  N,  leading  to  a  maximum  likelihood,  LN,  for  that 
value  N.  One  obtains  the  overall  ML  estimates  (Ns,0)  by  evaluating  LN  over  a 
range  of  N  values  and  taking  the  ML  estimates  to  be  those  values  of  (N,  0)  that 
provide  the  maximum  LN.  This  approach  was  taken  by  Norris  and  Pollock  (1996)  (see 
Section  2.1.2)  for  Mh  and  M^  closed  population  models  with  0  being  an  unspecified 
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mixing  distribution  on  the  individual  capture  probabilities.  The  advantage  to  this 
approach  is  that  this  search  procedure  (usually)  yields  the  true  maximum  likelihood 
estimates  for  (TV,  0)  under  the  restriction  that  TV  is  an  integer.  Disadvantages  include 
the  computational  complexity  of  a  search  procedure  consisting  of  maximizing  the 
log-likelihood  for  many  different  values  of  TV  and  the  fact  that  one  must  put  some 
restrictions  on  the  range  of  TV  values  since  Ln  cannot  be  computed  for  all  TV  >  n. 
It  is  because  of  this  second  point  that  we  say  the  true  ML  estimate  is  usually  found, 
since  the  maximized  log-likelihood  as  a  function  of  TV"  need  not  be  unimodal.  We  will 
discuss  this  point  further  in  Chapter  3. 

2.2.3     TV  As  Continuous 

A  third  approach  to  computing  the  overall  ML  estimates  treats  TV  as  a  continuous 
variable  and  employs  numerical  optimization  techniques  to  maximize  L  with  respect 
to  (TV,  6).  One  does  this  by  substituting  the  factorial  terms  in  L  by  gamma  functions, 
so  that  the  objective  function  to  be  maximized  becomes 

Z(iV'0;n)  =  T{NN-  n  +  i)Tu^  •  •  ^...m"0"1*^*)"-". 

With  the  development  of  dependable,  general-purpose  numerical  optimization  algo- 
rithms, this  maximization  is  straightforward.    The  resulting  TV-estimates  from  the 
three  approaches  are  normally  very  similar.  Sanathanan  (1972)  claimed  that  neces- 
sarily TVC  <  TV.   Our  experience  has  been  that  either  TV5  =  [TV]  or  TVS  =  [TV  + 1 
always  since  the  maximized  log-likelihood  is  a  smooth  function  of  TV. 

2.3     Methods  for  Constructing  Confidence  Intervals  for  TV 

Much  of  the  recent  research  in  capture-recapture  modelling  has  focused  on  meth- 
ods of  constructing  confidence  intervals  for  TV.    Although  Sanathanan  derived  the 


26 

asymptotic  normality  of  N  as  the  true  population  size  increases,  confidence  intervals 
based  on  asymptotic  normality  of  the  estimator  are  often  unsatisfactory  since  the 
estimate  is  often  based  on  small  samples.  This  can  result  in  a  skewed  distribution  for 
N  and  a  lower  confidence  limit  that  is  less  than  n.  As  a  result,  the  bootstrap  and 
profile  likelihood  methods  of  Buckland  and  Garthwaite  (1991)  and  Cormack  (1992), 
respectively,  are  often  preferred  over  ones  based  on  the  asymptotic  normality  of  N. 

2.3.1     Profile  LtKelihood  Confidence  Interval 

The  alternative  definition  (2.7)  for  the  conditional  estimate  Nc  suggests  a  pro- 
file likelihood  approach  to  constructing  confidence  intervals  when  using  this  point 
estimate.  Since  no...o  is  the  value  that  produces  the  minimum  G2  statistic  from  the 
complete  table,  a  100(1  —  a)%  profile  likelihood  confidence  interval  is  based  on  those 
values  for  the  unobserved  cell  that  increase  the  LR  statistic  for  a  model  fitted  to  the 
complete  table  by  a  value  less  than  X\a-  This  interval  rejects  candidate  values  no...o 
for  which  the  likelihood  under  the  model  is  sufficiently  less  than  the  maximum  value. 
For  95%  confidence  intervals,  we  accept  all  values  fio...o  that  increase  the  LR  statistic 
by  Xi,.o5  =  3-84  or  less.  If  all  n0...o  values  in  the  interval  (a,  b)  satisfy  this  criterion  for 
the  missing  cell  count,  then  (n  +  o,n  +  5)  is  the  confidence  interval  for  N. 

The  cutoff  value  xi,a  ls  based  on  the  asymptotic  framework  in  which  N  — >  oo. 
Hall  (1994)  argued  in  a  related  iV-estimation  problem,  that  of  k  i.i.d.  binomial(iV,  p) 
observations  with  both  N  and  p  are  unknown),  that  an  alternative  asymptotic  frame- 
work assuming  the  unknown  parameter  N  is  fixed  is  more  appropriate.  Moreover, 
Hall  showed  that  the  iV-estimator  is  not  distributed  as  a  standard  normal  random 
variable,  but  rather  has  a  Cauchy  distribution.  We  note  that  in  an  analogous  asymp- 
totic framework  for  the  capture-recapture  setting,  this  chi-squared  cutoff  might  not 
be  the  most  appropriate  one.  Simulations  in  Chapter  5,  however,  demonstrate  that 
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the  above  profile  likelihood  intervals  do  maintain  coverage  that  is  close  to  the  nominal 
level  in  many  practical  situations. 

2.3.2     Boostrap  Confidence  Intervals 

We  describe  both  the  ordinary  percentile  and  the  BCa,  or  bias-corrected  and 
accelerated,  percentile  bootstrap  confidence  intervals.  We  first  describe  these  intervals 
for  a  generic  estimation  problem  before  applying  the  methods  to  the  capture-recapture 
problem. 

The  Bootstrap 

The  bootstrap  is  based  on  the  idea  of  a  plug-in  rule.  Suppose  we  wish  to  esti- 
mate the  parameter  0  =  6(F)  from  some  random  sample  x  =  (x\,. . .  ,xn)  generated 
from  the  probability  distribution  F.  The  plug-in  principle  estimates  6  by  6  =  6(F), 
where  F  is  some  estimate  of  the  probability  distribution  generating  the  observed  data. 
Often,  0(F)  does  not  have  simple  form  and  must  be  computed  by  Monte  Carlo  resam- 
pling. This  procedure  generates  B  resamples,  x*i, . . .,  x*B  according  to  the  estimated 
probability  distribution  F.  One  then  computes  the  statistic  of  interest  from  each  of 
the  resamples  to  obtain  the  bootstrap  replicates  0* , . . . ,  6*B. 

The  nonparametric  bootstrap  takes  as  the  estimate  of  F  the  empirical  distribution 
function  based  on  the  original  data;  that  is,  F  places  mass  1/n  on  each  of  the  n 
observed  data  points  Xi,  i  —  1, . . . ,  n,  and  mass  0  for  any  point  not  observed.  One 
then  resamples  with  replacement  from  F.  One  can  exploit  any  knowledge  one  might 
have  concerning  the  form  of  the  underlying  distribution  by  using  the  parametric 
bootstrap.  The  parametric  bootstrap  assumes  the  functional  form  of  the  distribution 
to  be  known  up  to  a  vector  of  unknown  parameters,  so  that  F  =  F\.  The  estimate 
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F  =  Ft  is  the  assumed  functional  form  with  some  estimate  A  replacing  the  unknown 
A. 

Percentile  and  BC^  Intervals 

Efron  and  Tibshirani  (1993,  pp.  168-169)  motivate  the  use  of  percentile  bootstrap 
intervals  as  follows.  Let  9  be  as  above  and  let  a§  be  its  estimated  standard  error. 
Consider  the  standard  normal  100  •  (1  —  2a)%  confidence  interval 

(6-z{a)a§,6  +  z{1-a)a§)  (2.9) 

for  9  based  on  the  assumption  9  ~  N  \9,aj).  Let  the  resample  9*  be  an  observation 
from  a  N(9,aj)  distribution.  The  lower  and  upper  confidence  limits  of  (2.9)  are 
the  ath  and  (1  -  a)th  percentiles  of  0*'s  distribution.  Therefore,  if  ^  is  the  normal 
distribution  function  of  9*,  the  confidence  interval  has  the  form  (^^(a),  ^_1(1  —  a)). 
This  suggests  a  way  to  construct  general  percentile  intervals. 

Let  9*  be  defined  as  in  the  previous  section  and  let  H  be  the  distribution  function 
of  9*.  Interval  (2.9)  suggests  the  bootstrap  interval  (H~1(a),  H~l(l  -a)).  In  practice, 
we  must  estimate  the  cdf  H  as  the  empirical  distribution  of  the  B  bootstrap  replicates 
{91},  so  that  the  confidence  endpoints  are  the  ath  and  (1  -  a)th  percentiles  of  this 
empirical  distribution. 

If  there  exists  a  transformation  u  such  that  u{9)  is  normally  distributed  with  mean 
u(9)  and  some  finite  variance,  the  percentile  method  can  be  thought  of  as  a  means  of 
constructing  an  ordinary  normal  interval  (a,  b)  for  u{9)  and  then  transforming  back  to 
the  (u_1(a),u_1(6))  interval  for  9  without  knowing  the  correct  transformation.  This 
means  the  percentile  interval  generalizes  the  ordinary  normal  interval  by  requiring 
some  unknown  transformation  of  9  to  be  normally  distributed  instead  of  requiring  9 
itself  to  be  normally  distributed. 
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Efron  (1987)  improved  upon  the  percentile  interval  idea  by  introducing  the  bias 
corrected  and  accelerated,  or  BCa,  interval.  Efron's  motivation  for  the  BCa  interval  is 
as  follows.  Suppose  there  exists  an  increasing  transformation  u  such  that  for  4>  —  u(9) 
and  <j>  =  u(8),  we  have 

l-4> 


se$ 


where 


scp  =  se^ 


N(-z0,l),  (2.10) 


a((j)  -  4>0) 


and  4>0  is  any  convenient  reference  point  on  the  scale  of  <f>  values.  The  bias-corrected, 
or  BC,  interval  is  the  special  case  when  a  =  0.  Then,  this  means  the  BCa  interval 
further  generalizes  the  ordinary  normal  intervals  by  allowing  for  a  normal-inducing 
transformation,  <f>,  to  have  bias  z0  when  estimating  the  true  (f>,  and  standard  deviation 
that  changes  according  to  the  value  of  the  parameter  (j).  To  construct  the  adjusted 
intervals,  one  estimates  the  bias  and  acceleration  by 

and 

a=6{E^V}3/2'  (2-11) 

where  /  is  the  indicator  function,  $  is  the  standard  normal  cdf,  and  £/,  is  the  ith 
infinitesimal  jackknife  value,  or  empirical  influence  component.  For  ease  of  computa- 
tion, one  can  substitute  the  ith  jackknife  value  from  the  Section  2.1.2  for  C/j,  so  (2.11) 
becomes 

._     E?=1«?(.)-%))3 

6£?=1(<?(.)-<y2}3/2' 
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One  then  calculates  a  percentile  interval  using  percentiles  of  the  empirical  distribution 
adjusted  for  the  bias  and  acceleration: 

BCa  interval  =  (0*(ai),0%(<*2)), 

where 

<*i  =  $  ( z0  + 


z„  +  z(a) 


1  -  a{z0  +  aK°))j 

a2  =  $\Zo  + 


z0  +  zQ-"') 


1  -  a{z0  +  zV-o'))  J  ' 

Efron  (1987)  details  the  theoretical  advantages  of  the  BCa  interval  over  the  ordinary 
percentile  interval.  Notice  that  the  ordinary  percentile  interval  is  a  special  case  of 
the  BCa  interval  with  z0  and  o  both  equal  to  zero.  Thus,  if  model  (2.10)  holds  but 
the  bias  and  standard  deviation  acceleration  are  neglible,  the  percentile  interval  will 
perform  adequately. 

The  Bootstrap  Applied  to  Capture-Recapture 

For  the  capture-recapture  setting,  the  underlying  distribution  F  =  Mult(iV,  7r) 
generates  the  observed  data  n.  Thus,  we  generate  B  resamples  (n*l5 . . . ,  n*B)  from 
an  estimate  of  the  distribution  F  -  Mult(iV,7r)  and  calculate  (N*,...,Ng).  The 
100(1  —  2a) %  percentile  confidence  interval  in  this  case  has  endpoints  that  are  the 
empirical  a  and  1  -  a  percentiles  of  the  N*  values  (Buckland  and  Garthwaite,  1991). 
The  BCa  interval  computes  z0  and  d  as  above  to  obtain  the  percentile  adjustments 
ai  and  a2.  We  believe  this  is  a  useful  modification  for  the  capture-recapture  appli- 
cation, and  we  recommend  this  type  of  bootstrap  interval  over  the  percentile  interval 
for  capture-recapture  problems  for  two  reasons.  First,  there  exists  a  controversy  in 
the  bootstrap  literature  as  to  the  validity  of  the  ordinary  percentile  interval  (Hall, 
1994).    Second,  little  is  known  about  the  small  sample  properties  of  iV-estimates. 


31 

Thus,  the  more  general  assumptions  of  the  BCa  interval  are  safer  since  we  cannot 
verify  the  stricter  assumption  that  there  exists  some  transformation  of  N  that  has  a 
normal  sampling  distribution  with  mean  N  and  constant  variance.  Bootstrap  theory 
has  shown  that  the  bootstrap  BCa  confidence  intervals  have  nice  properties,  in  the 
form  of  second-order  correctness,  when  the  parameter  (and  estimate)  is  a  smooth 
function  of  means  (Hall,  p.  52).  We  note,  however,  that  although  the  bootstrap  has 
been  proposed  in  the  capture-recapture  framework  and  is  probably  the  most  popular 
method  of  computing  confidence  intervals  in  this  setting,  the  theoretical  properties 
of  this  bootstrap  are  unknown  since  this  setting  does  not  fall  under  this  "smooth 
function  model"  framework. 

For  the  percentile  bootstrap,  the  parametric  version  assumes  that  the  n  are  gen- 
erated from  the  parametric  model  using  the  ML  estimates  as  the  true  parameters, 
F  =  Mult(iV,  7r).  Efron  (1987)  showed  that  when  a  random  variable  has  finite  sup- 
port, the  nonparametric  and  parametric  BCa  intervals  are  theoretically  equivalent. 
Since  we  are  resampling  from  a  multinomial  distribution  with  finite  support,  we  only 
consider  nonparametric  BCa  intervals  in  the  capture-recapture  setting  since  Efron's 
result  applies  here. 

Buckland  and  Garthwaite  (1991)  proposed  a  nonparametric  bootstrap  that  resam- 

ples  from  a  multinomial  distribution  with  index  N  and  probabilities 


V  N  '    N  '""'  N )  ' 

This  is  not  a  nonparametric  bootstrap  in  the  truest  sense,  but  rather  a  semiparamet- 
ric  boostrap  since  we  are  forced  to  use  the  estimate,  N,  from  the  assumed  model  to 
estimate  the  underlying  distribution  F.  We  investigate  an  alternative,  strictly  non- 
parametric bootstrap  that  resamples  from  the  conditional  multinomial  distribution 
of  the  observed  cell  counts  given  n.  Thus,  we  bootstrap  the  conditional  estimate 
Nc  of  Section  2.2.1  by  resampling  from  the  conditional  multinomial  distribution, 
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Mult(n,  (ni...i/n, . . . ,  n0...i/n)).  We  investigate  the  performance  of  both  of  these  boot- 
straps in  Chapter  5. 


CHAPTER  3 
CAPTURE-RECAPTURE  MODELS  ASSUMING  LOCAL  INDEPENDENCE 


We  now  consider  mixed  capture-recapture  models  that  allow  for  population  het- 
erogeneity and  variable  sampling  effort.  In  this  chapter,  we  focus  on  models  that 
assume  that  the  dependencies  among  the  t  sampling  occasions  arise  solely  from  the 
differences  between  subjects.  We  consider  alternative  forms  of  dependence  in  Chapter 
4. 

We  investigate  the  use  of  two  mixed  models,  the  logistic-normal  model  and  a 
latent  class  model,  and  the  log-linear  model  of  homogeneous  two-factor  interaction. 
We  motivate  all  three  of  these  models  from  the  logistic  model  that  contains  a  sep- 
arate parameter  for  each  subject  in  the  population  and  for  each  sampling  occasion. 
Sections  3.1  and  3.2  review  estimation  and  interpretation  of  the  models  in  their  tradi- 
tional application,  when  all  N  individuals  are  observed.  This  complete  table  method- 
ology will  prove  useful  when  computing  the  profile  likelihood  confidence  intervals  of 
Section  2.3.1.  Section  3.3  discusses  their  extensions  to  the  capture-recapture  setting 
and  is  followed  by  an  example  based  on  a  six-sample  experiment  designed  to  estimate 
the  size  of  a  snowshoe  hare  population  in  Section  3.4. 

Section  3.5  uses  another  example,  a  study  designed  to  estimate  the  number  of 
people  who  contracted  the  hepatitis  A  virus  during  a  hepatitis  outbreak,  to  demon- 
strate the  difficulties  associated  with  the  use  of  the  mixed  models  of  Section  3.1  and 
3.2.  Section  3.6  draws  analogies  between  the  behavior  of  the  A^-estimates  obtained 
from  these  models  and  other  well-studied  A^-estimation  problems  and  is  followed  by 
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comments  in  Section  3.7.  We  defer  simulation  studies  that  examine  the  performance 
of  the  AT-estimates  presented  in  this  chapter  until  Chapter  5. 

3.1     A  Logistic  Model  with  Subject  Heterogeneity 

For  subject  s,  s  =  1, . . . ,  N,  let  y's  =  (ysX, ...,  yst)  be  a  vector  of  t  binary  mea- 
surements (0  or  1),  where  ySj  =  1  denotes  capture  in  sample  j.  Let  psj  =  P{ySj  —  1)- 
We  permit  subject  heterogeneity  using  the  model 

"«(t^)-*+*  «"> 

Original  applications  of  the  model  (Rasch,  1961)  referred  to  t  test  items,  making 
the  model  popular  in  educational  testing,  where  it  is  known  as  the  Rasch  model.  In 
fitting  the  model,  one  assumes  independence  of  responses  across  occasions  for  a  given 
subject,  termed  local  independence,  and  independence  between  subjects. 

Standard  ML  asymptotics  do  not  apply  to  this  model,  since  as  the  number  of 
subjects  (N)  grows,  so  does  the  number  of  model  parameters.  Thus,  the  ML  estimate 
of  (3  =  (/?!, . . .,&)  is  not  consistent  (Andersen  1980).  Let  fy  denote  the  ML  estimate 
of  (3j,  j  =  1, . . . ,  t.  It  is  well-known  that  when  t  =  2,  fo  —  $i  A  1{fc  -  fa)  as  N  ->•  oo 
(Andersen  1980).  Ghosh  (1995)  proved  inconsistency  for  t  >  2. 

3.1.1     Conditional  Maximum  Likelihood 

Two  approaches  are  used  to  overcome  the  inconsistency.  The  first,  a  fixed-effects 
approach,  treats  {as}  as  nuisance  parameters  and  eliminates  them  by  conditioning  on 
their  sufficient  statistics,  then  maximizing  the  conditional  likelihood,  yielding  condi- 
tional ML  (CML)  estimates  (3°.  As  in  Chapter  1,  let  1  =  {(1, . . . ,  1), . . . ,  (0, . . . ,  0)} 
be  the  set  of  2*  possible  sequences  of  responses  (yal, . .  .,yst),  in  lexicographic  order, 
and  denote  1  =  {(1, . . . ,  1), . . . ,  (0, . . . ,  0, 1)}  as  the  set  of  observable  sequences.  Let 
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i  =  (i\,...,it)  be  an  element  of  1,  and  let  n-,  =  n^_it  be  the  number  of  subjects 
having  that  sequence.  Tjur  (1982)  showed  that  the  CML  estimates  are,  equivalently, 
ML  estimates  of  main  effect  parameters  in  a  log-linear  model  of  quasi  symmetry  fitted 
to  the  2*  table  of  counts  {n-,}.  Specifically,  letting  {fa  =  E(m)},  the  log-linear  model 
is 

log(/V..n)  =  /x  +  frl{ix  =  1)  +  •  •  •  +  Ptl(it  =  1)  +  A(»i, . . . ,  it),  (3.2) 

where  the  parameter  A(«i,...,tt)  is  invariant  to  permutations  of  its  arguments  and 
the  /(•)  function  is  an  indicator. 

The  quasi-symmetry  model  (3.2)  is  easily  fit  in  standard  statistical  software  such 
as  GLIM  or  SAS  (PROC  GENMOD).  The  model  implies  that  the  binary  response 
has  the  same  association  for  each  pair  of  items  and  corresponds  to  a  random  effects 
approach  in  which  one  assumes  that  the  ability  parameters  are  distributed  according 
to  some  completely  unspecified  distribution  F.  To  see  this,  suppose  ai,...,aN  are 
independently  and  identically  distributed  according  to  the  unknown  cumulative  dis- 
tribution F.  For  subject  s,  model  (3.1)  states  that  the  probability  of  having  capture 
history  y^  =  (ysl , ys2, ..., yst),  8  =  1, . . . , JV,  is 

JUL  i  +  e^+pi  =  rr?=i(i  +  ea'+^) 

Thus,  the  marginal  probability  of  response  pattern  i  €  X  is 

q  =  ,„...„  =  exp(g  fify) I  n-=f (i  Z°.^)dF{a'}  (3'3) 

We  notice  that  the  integral  in  (3.3)  is  a  complex  function  of  /3  that  depends  on  the 
data  only  through  the  sufficient  statistics  S-,  -  £<=1  ij,  the  raw  score  for  pattern  i. 
These  marginal  probabilities  then  have  structure  that  is  a  special  case  of 

t 
*ii...it  =  exp(^  0jij)h(ii, ...,  it),  (3.4) 
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where  h  is  a  parameter  that  is  invariant  to  permutations  of  its  arguments.  Taking  the 
natural  logarithm  of  both  sides  of  (3.4)  gives  (3.2).  This  nonparametric  formulation 
will  prove  important  when  we  consider  the  model's  utility  in  the  capture-recapture 
setting. 

We  will  see  in  Section  3.3  that  fitting  this  model  provides  no  information  on  the 
population  size.  Darroch  et  al.  (1993)  and  Agresti  (1994)  proposed  the  simpler 
log-linear  model  of  homogeneous  two-factor  interaction  (H02), 

log(/v.,J  =  a  +  &/(ii  =  1)  +  . . . ,  PJ(it  =  l)+(  E5=i  %i  \  a,  (3.5) 

for  capture-recapture.  This  model  is  the  special  case  of  the  log-linear  model  of  no 
three-factor  interaction  in  which  all  associations  are  identical.  It  is  also  a  special  case 
of  the  quasi-symmetry  model  (3.2)  in  which  only  the  second-order  interactions  are 
allowed  to  differ  from  zero.  This  simple  model  has  only  one  more  parameter  than  the 
model  of  mutual  independence  of  the  t  responses,  which  is  (3.5)  with  A  =  0.  This 
model  proves  useful  for  estimating  the  population  size  since  the  quasi-symmetry  model 
provides  no  iV-estimate.  Chapter  5  will  show  that  confidence  intervals  for  TV  produced 
by  this  model  have  good  coverage  probabilities  when  population  heterogeneity  is 
present. 

3.1.2     Marginal  Maximum  Likelihood  (MML)  Approach  to  Estimation 

A  second  approach  treats  {as}  as  random  effects,  typically  having  a  normal  dis- 
tribution with  mean  0  and  unknown  variance  a2,  for  which 

\ogit(psj)  =  aZs  +  fa  (3.6) 

with  Zs  ~  A/'(0, 1).  We  refer  to  this  model  as  the  logistic-normal  (LN)  model.  One 
integrates  over  this  distribution  to  obtain  the  "marginal  likelihood"  of  (a,  (3)  given 
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the  2*  observed  cell  counts.  The  fitted  counts  from  the  marginal  model  have  quasi- 
symmetric  structure,  since  the  model  assumes  a  particular  form  for  F  in  equation 
(3.3).  This  model  also  has  only  one  more  parameter  than  the  model  of  mutual  inde- 
pendence, which  is  (3.6)  with  a  =  0.  Bock  and  Lieberman  (1970),  Bock  and  Aitkin 
(1981),  and  Thissen  (1982)  discuss  a  direct  method  of  maximizing  the  log-likelihood 
based  on  the  Newton-Raphson  algorithm. 

Direct  Approach  to  Maximization. 

A  direct  approach  to  MML  estimation  maximizes  a  Guassian  quadrature  approx- 
imation to  the  marginal  log-likelihood  using  a  maximization  algorithm.  Bock  and 
Aitkin  (1981)  demonstrated  using  the  Newton-Raphson  algorithm  for  a  general  item- 
response  model. 

The  probability  that  a  subject  with  ability  Z  has  capture  history  i,  i  €  X  is 

7ril2=ni+e(,z+^)- 

Thus,  the  probability  that  a  randomly  selected  subject  has  that  pattern  is  the 
marginal  probability 


r  /"    -rr    elw+pi>> 


t  eij((TZ+^)) 


<f)(z)dz,  (3.7) 


where  4>(z)  is  the  standard  normal  density.    This  yields  the  marginal  multinomial 
log-likelihood  for  (a,  j3)  given  the  cell  counts  n, 

l{a,  (3;  n)  a  £ nilogfa).  (3.8) 

iei 

Since  no  closed-form  expressions  exist  for  the  integral  in  (3.8),  one  can  use  numer- 
ical integration  to  obtain  an  approximation.     Gauss-Hermite  quadrature  (Stroud 
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and  Secrest  1966)  approximates  this  integral  of  form  /  f(z)(f)(z)dz  by  the  expres- 
sion Sfc=i  f{zk)l/k,  where  the  zks  are  known  as  quadrature  points  or  nodes  and  the 
iVs  are  the  corresponding  weights.  The  choice  of  the  number  of  quadrature  points 
q  determines  the  degree  of  accuracy,  and  the  weights  uk  are  usually  scaled  to  satisfy 
YX=\  uk  =  !■•  Thus,  the  marginal  probabilities  (3.7)  are  approximated  by 


fc=l 


11  1  -I-  e(azk+/3j) 


Vk, 


and 


J(a,/3;n)oc5>|log(7r,)  (3.9) 

is  the  objective  function  maximized  with  respect  to  (<j,0). 

Newton-Raphson  has  traditionally  been  popular  for  ML  analysis  because  it  pro- 
vides an  estimate  of  precision  of  the  ML  estimates  as  a  by-product  of  the  algorithm. 
Suppose,  in  general,  we  wish  to  maximize  a  nonlinear  function  g(0)  with  respect  to 
the  unknown  parameter  vector  0.  Let  0^  be  the  pth  guess  for  0,  the  value  that 
maximizes  g.  Let  q'  =  (dg/d$i,dg/d02, . . .),  H  denote  the  matrix  having  entries 
hij  —  d2g/d6id0j,  and  q^  and  H^  be  the  corresponding  quantities  evaluated  at 
0^\  At  iteration  p,  the  (p  +  l)st  guess  relies  on  the  Taylor  series  expansion  of  g(0) 
around  0{p\ 

q^p\0)    g{0{p))  +  q«'(0  -  0^)  +  he  -  e^yH^He  -  ew).  (3.10) 

Solving  dQW(0)/d0  =  qW  +  H<">(0  -  0<">)  =  0  yields  the  (p  +  l)st  guess  for  0, 

0(p+1)=^-(H^)_1q(P),  (3.11) 

as  long  as  H^  is  nonsingular. 


For  the  logistic-normal  model,  0  =  (a,  (i)  and  g{6)  =  I.  Denote 


exp(azk  +  fa) 

Pjk  =  Pjk{0)  =  — — —, ~rr. 

1  +  exp(azk  +  fa) 
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The  Ith  element,  I  =  1,  ...,<  +  1,  of  the  score  vector  q 


is 


dl       —  m  diti 


(3.12) 


If  we  rewrite 


k=\ 


(3.13) 


where 


f*=I[[p%(l-Pik)1-i> 


then  the  elements  of  the  score  vector  have  the  form 


(3.14) 


Using  the  identity  that,  for  any  function  /(•)  and  parameter  9, 


21  Mftggfla 

m    J{  '    de    '■ 


(3.15) 


equation  (3.14)  can  be  reexpressed  as 


Z^l^niWik^——,  l  =  l,...,t  +  l, 


(3.16) 


where  wik  =  fiki/k/{El=i  fih"h), 


dlog/ifc       ^      (■  V 


and 


aiog/i 


\k 


(ij-Pjk),  i  =  i,...,t 


The  Hessian  matrix  H  has  elements 
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him  = 


d2l 

d9,0n 


fc=i  iei      \ 


de,e. 


IV  m 


~d\ogfik 

50, 

d$m 

where 


and 


d2\ogfu 
da2 


a2iog/ife 

dadfy 
d2\ogfu 


m 


■«*bj*(i-Pi*)], 


-Pi*(l  -Pi/t)r 


d2log/ifc 
dfydp? 


=  0, 


0^         (ELl  /i*u*)  /ifc^fc 


alog/it 


90„ 


/ifc^/fc 


<90„ 


n-i  ( w^) 


(ELi  /i*"*)' 


The  observed  information  matrix,  H-1  =  (H(0))_1,  is  an  estimate  of  the  large-sample 
variance  covariance  matrix  for  9  =  (a,J3). 

We  choose  to  use  another  maximization  algorithm  for  direct  maximization  of 
the  log-likelihood  since  we  will  not  base  confidence  intervals  on  the  large-sample 
standard  errors.  Feasible  Sequential  Quadratic  Programming  (FSQP)  (Zhou  and 
Tits,  1994)  is  a  set  of  high-quality  FORTRAN  subroutines  for  the  minimization  of 
a  smooth  objective  function  subject  to  nonlinear  equality  and  inequality  constraints, 
linear  equality  and  inequality  constraints,  and  simple  bounds  on  the  variables.  These 
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routines  are  based  on  an  iterative  algorithm  that  searches  away  from  a  given  feasible 
iterate  in  an  arc  whose  direction  is  determined  by  an  estimate  of  the  Hessian  of  the 
Lagrangian.  This  arc  search  along  a  function's  surface  is  known  as  an  Armijo  type 
search.  We  use  FSQP  to  provide  the  MML  estimate  (MMLE)  of  0  by  minimizing  the 
negative  of  equation  (3.9).  We  maximize  the  log-likelihood  with  the  only  constraint 
being  a  lower  bound  of  zero  for  the  variance  component  a. 

Indirect  Maximization 

For  completeness,  we  outline  an  indirect  approach  to  MML  estimation  in  the 
logistic-normal  model.  This  approach  takes  the  form  of  an  Expectation-Maximization 
(EM)  algorithm  (Demptster,  Laird,  and  Rubin,  1977)  and  is  based  on  the  observation 
that  the  likelihood  equations  take  the  simple  form  of  those  from  a  weighted  generalized 
linear  model.  Specifically,  the  score  equations  (3.16)  can  be  rewritten  as 

dl         q     ' 

o~  =  E  H  zk  [%fc(l  "  Pjk)  ~  Nkpjk]  =  0 


and 


aj"  q 

aT  =  £  K-*(l  -  Pjk)  -  NkPjk]  =  0,  j  =  1, . . . ,  t 


where 


ATfc  =  £niwifc  (3.17) 

iex 

can  be  interpreted  as  the  expected  number  of  individuals  with  a  latent  variable  value 
of  Zk  and 

"jfe  =  H  riiijWik  (3.18) 
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is  the  number  of  subjects  with  catchibility  zk  expected  to  be  captured  on  occasion 
j.  These  equations  take  the  familiar  form  of  the  likelihood  equations  for  a  logistic 
regression  analysis  of  n^  successes  out  of  Nk  trials. 

This  formulation  suggests  an  iterative  EM  procedure.  At  the  pth  step,  given  pa- 
rameter values  d^\  the  expectation  step  computes  {nfk}  and  {Nk  }  using  (3.17)  and 
(3.18).   The  maximization  step  obtains  updated  parameter  estimate  0^+^  through 

an  ordinary  logistic  regression  analysis  of  {nfk}  successes  out  of  {N\p  }  trials.  One 
typically  iterates  between  the  two  steps  until  some  criterion,  such  as  the  change  in 
successive  deviances  or  the  maximum  change  in  successive  parameter  values,  is  less 
than  some  pre-determined  tolerance. 

The  Newton- Raphson  and  EM  methods  of  estimation  both  have  advantages  and 
disadvantages.  The  Newton-Raphson  algorithm  converges  relatively  quickly,  having 
a  quadratic  convergence  rate,  and  provides  large-sample  standard  errors  for  the  MML 
estimates.  A  drawback  of  Newton-Raphson  is  the  complexity  of  the  derivatives  and 
that  the  repeated  inversion  of  H  becomes  computationally  intensive  for  large  t,  al- 
though with  today's  computing  facilities,  it  is  not  too  much  so. 

The  biggest  advantage  of  the  EM  algorithm  is  that  it  is  computationally  simpler 
than  Newton-Raphson  to  implement.  Since  the  EM  algorithm  updates  the  param- 
eter estimates  through  logistic  regression,  it  is  simple  to  program  the  algorithm  in 
standard  software  packages  such  as  SAS,  Splus,  or  GLIM.  The  algorithm  is,  however, 
notoriously  slow  in  converging,  with  convergence  becoming  very  slow  after  the  algo- 
rithm quickly  moves  to  a  neighborhood  of  the  estimates.  In  fact,  as  we  will  see  in  the 
next  section,  this  algorithm  has  the  potential  to  "stall";  that  is,  the  algorithm  can 
stop  prematurely.  Also,  the  EM  algorithm  does  not  provide  standard  error  estimates 
without  additional  computation. 
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After  estimating  the  parameters,  the  fit  of  the  assumed  model  can  be  assessed  by 
the  likelihood  ratio  statistic 


^  =  2[5>,log^|,  (3.19) 


where  tt\  =  iti(a,(3)  is  the  estimate  of  the  Gaussian  quadrature  approximation  of  jij, 
i  £  X.  If  all  expected  frequencies  are  greater  than  or  equal  to  five,  this  LR  statistic 
has  an  approximate  x2  distribution  with  df=(2*  —  1  free  cell  probabilities)- (t  +  1 
parameters) =2*  —  t  —  2. 

3.2    A  Latent  Class  Model 

This  chapter  also  applies  a  latent  class  model  to  the  capture- recapture  problem. 
General  latent  class  models  were  first  introduced  by  Goodman  (1974).  In  general 
terms,  suppose  we  observe  measurements  on  a  set  of  t  categorical  variables  {Vj}, 
where  Vj  has  Lj  levels,  j  =  l,...,t,  so  that  subjects  can  be  cross-classified  into  a 
EIj=i  Lj  contingency  table.  Latent  class  models  postulate  the  joint  distribution  of  the 
t  observed,  or  manifest,  variables  as  a  mixture  of  L  distributions,  defined  by  L  classes 
of  a  latent,  or  unobservable,  categorical  variable  Z.  This  latent  variable  categorizes 
individuals  into  L  homogeneous  classes.  Each  of  the  L  components  of  the  mixture 
distribution  are  assumed  to  satisfy  mutual  independence  among  the  t  variables,  so 
that  observed  associations  among  these  manifest  variables  are  a  product  of  differences 
between  latent  classes.  If  we  let  (»i,  • . .,  it)  be  a  subject's  classification  according  to 
the  t  manifest  variables,  and  (*i,...,tt>*z)  be  the  joint  response  to  these  variables 
along  with  their  latent  class  membership,  the  observed  counts  {n^...^}  represent  a 
collapsing  of  the  n*=i  LjxL  table  over  the  levels  of  Z.  Assuming  mutual  independence 
of  (Vi, . . . ,  Vt)  given  Z  implies  that  the  cell  counts  in  this  ITJ_i  A?  x  L  table  satisfy 


L 

Hexp 

(a,z 

t 

\VkZ 

44 
the  log-linear  model 

log(^,..Mj  =  £A£+Afz  +  £A^. 

A:=l  fc=l 

Thus,  the  observed  counts  satisfy 

t 

log(/*i...*)  =  H  A£  +  log 

fe=i 

3.2.1     Quasi-Svmmetric  Latent  Class  Model 

We  consider  a  special  case  of  this  general  latent  class  model  that  requires  the 
associations,  {\3jiz}  between  the  latent  variable  and  the  t  manifest  variables  to  be 
identical.  This  latent  class  model  is  a  special  case  of  models  introduced  by  Lindsay 
et  al.  (1991)  and  Agresti  and  Lang  (1993).  If  we  assume  there  are  only  two  latent 
classes,  this  model  is  the  special  case  of  the  logistic  model  (3.1)  with  only  two  possible 
values  for  as.  In  terms  of  {tHl...it},  it  has  the  quasi-symmetric  structure  whereby  the 
associations  between  the  binary  latent  variable  and  the  t  responses  are  identical. 

Relationship  to  Logistic-Normal  Model 

This  quasi-symmetric  latent  class  model  (QLC)  with  two  latent  classes  relates  to 
the  logistic-normal  model,  being  a  generalization  of  the  crude  approximation  of  it  that 
uses  only  two  quadrature  points.  When  the  {uk}  are  unknown,  the  logistic-normal 
model  with  q  =  2  is  equivalent  to  the  QLC  model  with  L  =  2.  Consider  the  three- 
sample  case  for  notational  convenience.  Generalizations  to  t  >  3  are  straightforward. 

Consider  the  marginal  probability  of  capture  history  i  =  (ti,t2,t3), 


7rtl«2t3 


r  3  r 


expjijjaz  +  fy)) 
1  -I-  exp(az  +  Pj) 


<j)(z)dz. 
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2-point  Gaussian  quadrature  yields  z  =  (z\,z2)  —  (—1,1),  but  with  only  2  nodes,  the 
model  is  equivalent  if  z  is  treated  as  a  factor:  z  =  (0, 1),  so  that 


K. 


Ill2t3 


exP  (  tl  PjVij     S  exP    S  azkii  + 
ij=i         /  k=\         \j=\ 


log(^)  -  log  JJ  (1  +  exp(azkij  +  fy)) 


Taking  the  log  of  both  sides  yields 


log(ft,t2ts)    =    Y,Piii  + 

loglj^exp  \Yd{(Tzkij)  + 

U=i       V^1 

This  model  satisfies  the  QLC  structure  of 


log(ffe)  -  log  IJ(1  +  exp(azkij  +  0j)) 


log(7rili2i3)  =  A,?  +  Ag  +  AJJ  +  log  (A^f  +  AjSf  +  Ajjf  +  Af)  ,  (3.20) 

where  the  item  parameters  /3  are  equivalent  to  the  main  effect  parameters  for  the 
manifest  variables  (A^1,  A^2, X^3).   The  association  parameters  X^k    =  A|J*  =  X%k 
equal  a  for  ij  —  1  and  k  =  2  and  0  otherwise,  satisfying  quasi-symmetry.    Also, 
constraining  Af  =  0  for  identifiability  yields 


Xz  - 
a2  — 


log(i/2)  -  log  JJ(1  +  exp(a  +  /?_,)) 


7  =  1 


log(^)-logII(l+exp(^)) 


j'=i 


The  QLC  model  with  two  latent  classes  also  implies  the  LN  (q=2)  model,  providing 
equivalence  between  the  two  models.  Consider  the  ML  estimates, 


*  —  (-V)  ^l1)^!2)^!3)^!  )  An), 
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for  model  (3.20),  where  An  is  the  common  value  of  X\\z  =  X\\z  =  X\\z .  Without  loss 
of  generality,  we  fit  this  model  with  the  latent  variable  Z  coded  so  that  this  association 
parameter  is  nonnegative.  If  this  is  not  the  case,  we  simply  change  the  coding  of  the 
levels  of  the  latent  variable  Z  from  (0,1)  to  (1,0).  Assuming  Aoo  >  0,  we  have  a  —  An, 
0\  =  A^1  -  A^1,  J32  =  X\2,  and  03  =  X^3.  The  values  uk,  k  -  1, 2  in  the  LN  model  are 
then  obtained  by  determining  the  values  for  v  =  (1/1,1/2)  that  satisfy  the  equations 


a2  — 


\og{v2)  -  log  flO  +  exP(^  +  Pj)) 


i=i 


log(^)-logn0+exp(^)) 


i=i 


and 


1/1+1/2  =  1. 


Thus,  there  is  a  one-to-one  equivalence  between  the  parameters  of  the  QLC  (L  —  2) 
model  and  the  LN  (q  =  2)  model. 

This  equivalence  between  the  two  models  can  be  generalized  in  that  the  QLC 
model  for  a  given  L  >  2  is  Aitkin's  (1996)  logistic-mixture  model,  which  places  no 
distributional  assumptions  on  the  mixing  distribution  other  than  it  has  L  mass-points. 
This  is  the  model  fit  sequentially  for  increasing  L  in  order  to  obtain  Aitkin's  NPML 
estimates  of  the  unknown  mass-points  a  =  (ai,...,aL),  weights  u  =  (i/1} . . .  ,uL), 
and  (3. 

A  simple  extension  of  the  previous  argument  shows  this  equivalence.  The  marginal 
probabilities  for  the  logistic-mixture  model  with  L  mass-points  is 


log(7Ti:...n)     =     !C&*J  + 


L  /  3 

log^exp  [52(Q**i)  + 


log(j/fc)  -  log  IIO  +  exp(aJfezi  +  /?,•)) 
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Arguing  as  in  the  q  =  2  case,  we  see  o^,  k  —  1, . . . ,  L,  are  the  common  association 
parameters  A^z  =  A]]2  =  A^£z  and  that 


Af  = 


log(z/fc)  -  log  J](l  +  exp(afc  +  #,•)) 


i=i 


log(i/i)  -  log  fl(l  +  exp(ai  +  j%)) 


i=i 


3.2.2     Estimation 


One  can  fit  this  model  using  the  EM  algorithm.  The  distribution  of  the  complete 
data,  the  n*=i  ^  x  L  contingency  table,  has  regular  exponential  form,  so  that  only  the 
complete  data  sufficient  statistics  must  be  estimated  at  each  E-step.  (See  Goodman 
(1974)  and  Lang  (1992)  for  an  EM  approach  to  latent  class  models  in  general  and 
Agresti  and  Lang  (1993)  for  this  specific  case).  The  i>k,  k  =  1,2,  are  the  values  that 
simultaneously  satisfy 


A, 


log(P2)  -  log  IJ(1  +  exp(<7  +  pj)) 


log^O-logna+exp^)) 


and 


vx  +  z>2  =  1. 


Alternatively,  we  estimate  (uua,/3)  using  FSQP.  This  optimization  routine  is 
much  faster  than  the  EM  algorithm,  which  can  stall  before  converging  to  the  maxi- 
mum likelihood  estimates. 

As  an  example,  consider  the  complete  table  based  on  the  data  from  Bock  and 
Aitkin  (1981)  that  consists  of  the  response  pattern  counts  of  1000  students'  re- 
sponses to  5  LSAT  questions.  The  data  are  displayed  in  Table  3.1.  FSQP  gives 
the  MMLE's  for  the  2-point  LN  model  with  arbitrary  weights  v  as  a  =  1.416, 
fc  =  (-3.240,-1.520,-0.761,-1.827,-2.616),  and  v  =  (0.621,0.379).  The  model 
fit  yields  deviance  G2  =  23.36  based  on  23  df.    The  parameter  estimates  for  the 
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quasi-symmetric  latent  class  model  obtained  from  the  EM  algorithm  using  GLIM  are 
reported  in  Table  3.2. 

Table  3.1.  Response  pattern  counts  and  the  fitted  values  of  two  mixed  models  of  1000 
students'  answers  to  5  dichotomously-scored  LSAT  questions 
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Table  3.2.    EM  Parameter  Estimates  for  the  Quasi-Symmetric  Latent  Class  Model 
Applied  to  the  LSAT  Data     


Parameter 

Estimate 

An 

1.416 

Ar1 

5.593 

A0Vl 

2.352 

Af2 

-1.520 

A? 

-0.761 

Ar< 

-1.827 

A? 

-2.616 

Af 

-2.292 

Notice  a  =  A„,  h  =  A?  -  A?,  ft  =  X\\  ft  =  A?,  ft  =  A|\  k  =  A?,  and 
Af  =  [log(.621)-logn5=i(l+exp(a  +  4))]  -  [log(.379)  -  lognJ=i(l  +  exp(4)) 
demonstrating  the  equivalence  of  the  two  models. 
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The  convergence  for  the  EM  algorithm  is  slow.  826  EM  iterations  were  required 
to  match  the  estimates  obtained  in  FSQP.  Also,  the  EM  algorithm  terminated  twice 
(after  336  iterations  and  345  iterations)  before  the  true  MLE's  were  obtained  even 
though  the  convergence  criterion,  the  change  in  successive  deviances,  was  tightened 
to  le-20.  This  propensity  of  the  EM  algorithm  to  "stall"  before  reaching  the  true 
MLE's  has  been  observed  in  fitting  other  generalized  linear  mixed  models  (Booth  and 
Hobert  1997). 

3.3     ML  Estimation  of  N 

We  now  discuss  fitting  the  models  outlined  in  the  previous  section  in  the  capture- 
recapture  setting.  Again,  we  refer  to  the  table  with  all  2*  cell  counts  known  as  the 
complete  table  and  the  one  with  n0...o  unknown  as  the  incomplete  table.  Recall,  also, 
from  Section  2.2  that  L  is  the  full  unconditional  likelihood,  L\  is  the  conditional 
(on  n)  likelihood,  and  L  is  the  approximate  likelihood  that  treats  N  as  a  continuous 
parameter. 

3.3.1     The  Logistic-Normal  Model 

Using  Gaussian  quadrature,  the  logistic-normal  model  of  Section  3.1.2  postulates 
the  form  of  the  probabilities  n\(0LN),  where  0LN  =  (a,  (3),  as 


ifi(<M  =  £ 


*       eij(<rzk+l3j)) 
1=1  1  _|_  e{crzk+Hj) 


vk,  i  e  X. 


One  can  easily  implement  the  conditional  (on  n)  approach  to  AT-estimation  of  Sec- 
tion 2.2.1  by  directly  maximizing  Lx  with  respect  to  (a,/3)  using  Newton-Raphson 
or  some  other  numerical  optimization  routine.    Denote  tt{Oln)  =  n  for  notational 
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convenience.  Since 


n!  tt   /  7Tj 


we  have 


/i  =  logli  oc  ]T  nilog(Tfi)  -  nlog  j  £  ^ 
and 

Thus,  the  likelihood  equations  used  to  obtain  0C  from  the  incomplete  table  are  sim- 
ply the  score  equations  for  the  complete  table  minus  the  term  corresponding  to  cell 
(0, . . . ,  0),  corrected  for  the  total  number  of  subjects  seen  during  the  experiment.  One 
then  calculates  Nc  using  (2.6).  Sanathanan  (1974)  incorporated  a  two-step  method 

of  estimating  (a,  j3)  by  estimating  (3    using  the  CML  approach  and  then  maximizing 

*  c 
Li(a,j3  )  with  respect  to  a.  The  95%  profile  likelihood  interval  of  Section  2.3.1  can 

be  constructed  by  using  one  of  the  complete  table  algorithms  of  Section  3.1.2  to  find 
the  n0...o  values  that  yield  a  likelihood  ratio  statistic  of  G2(n0...o)  +  3.84.  We  obtain 
Ns  by  simply  maximizing  L  with  respect  to  (a,  (3)  for  each  candidate  TV,  while  con- 
straining a  >  0.  Maximizing  L  with  respect  to  {N,6LN),  while  constraining  a  >  0, 
yields  N. 

3-3-2 Quasi-Symmetric  Loglinear  and  Latent  Class  Models 

From  Tjur  (1982),  the  fixed-effects  approach  of  CML  estimation  to  the  logistic 
model  is  equivalent  to  fitting  the  quasi-symmetric  loglinear  model  to  {m}.  Darroch  et 
al.  (1993)  and  Agresti  (1994)  noted  that  this  CML  estimation  provides  no  information 
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on  TV,  since  one  of  the  likelihood  equations, 

A0...0  =  ^o...O) 

shows  that  any  value  no...o  is  consistent  with  the  model.  Thus,  the  deviance  for  this 
model  remains  constant  for  all  TV  >  n  since  cell  count  no...o  makes  no  contribution 
to  the  test  statistic.  This  yields  the  profile  likelihood  confidence  interval  (n,  00)  for 
TV.  They  considered  special  cases  of  the  quasi-symmetry  model  for  which  this  is  not 
the  case.  For  instance,  the  log-linear  model  of  homogeneous  two-factor  interaction 
(3.5)  is  a  special  case  that  is  still  more  complex  than  the  loglinear  model  of  mutual 
independence  that  results  from  a  lack  of  subject  heterogeneity.  One  obtains  Nc  for 
this  model  using  standard  model  fitting  software  by  fitting  (3.5)  with  zero  weight 

for  cell  count  n0...o.  One  can  obtain  TV  by  numerically  optimizing  L  with  respect  to 
(N,/3,X)  in  expression  (3.5). 

One  could  compute  the  estimate  Nc  for  the  QLC  model  with  L  —  2  by  estimating 
(a,  (3,  u)  using  the  EM  algorithm  while  setting  the  weights  of  the  two  cells  in  the  2*  x  2 
table  that  correspond  to  the  unobserved  cell  in  the  2'  table  equal  to  zero.  Because 
of  this  algorithm's  potential  to  stall  (Section  3.2.2),  we  use  the  model's  equivalence 
to  the  logistic-normal  model  with  q  =  2,  and  use  FSQP  to  maximize  L\  with  respect 
to  dLC  =  (vi,a,/3).  We  also  use  FSQP  to  fit  the  complete  tables  generated  when 
searching  across  n0...o  values  to  obtain  a  profile  likelihood  confidence  interval.  We 
obtain  TV  with  FSQP  by  numerically  maximizing  L  with  respect  to  (TV,  0LC). 

3.4     Snowshoe  Hare  Example 

Cormack  (1989)  reported  a  capture-recapture  study  having  t  =  6  consecutive 
trapping  days  for  a  population  of  snowshoe  hares.  Table  3.3,  which  displays  the  data, 
shows  that  68  hares  were  observed.  The  TV-estimates  and  confidence  intervals  from  the 
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different  models  are  summarized  in  Table  3.4  for  ease  of  comparison.  The  logistic- 
normal  model  using  10-point  quadrature  (LN10)  yields  ac  =  0.96  and  Nc  =  92.0 
from  the  conditional  (on  n)  approach  and  a  =  0.91  and  N  =  89.0  from  numerical 
optimization.  These  point  estimates  remain  unchanged  with  better  approximations 
of  the  marginal  probabilities  (i.e.  q  >  10);  in  fact,  a  profile  of  both  Nc  and  N  across 
q  >  2  reveals  that  these  estimates  stabilize  for  q  >  5.  This  is  not  always  true,  however, 
and  we  examine  issues  related  to  the  estimation  of  a  in  the  next  section.  Table  3.3 
shows  the  model  fit  conditional  on  n. 

For  the  logistic-normal  model,  the  95%  profile  likelihood  interval  corresponding  to 
Nc  is  (74.8,148.5).  The  95%  parametric  percentile  bootstrap  interval  corresponding 
to  N  (with  B  =  1000)  is  (69.9,129.4).  The  95%  nonparametric  percentile  and  BCa 
bootstrap  intervals  are  (70.8,  231.5)  and  (71.8,  286.4),  respectively.  The  reason  for  the 
large  discrepancies  between  the  bootstrap  intervals  will  be  discussed  in  Section  3.5. 

The  log-linear  model  of  homogeneous  2-factor  interaction  gives  point  estimates 
almost  identical  to  the  logistic-normal  model,  with  Nc  =  90.5  and  TV  =  88.2.  All 
fitted  values  for  the  2*  -  1  observed  counts  were  no  further  away  than  .04  from 
the  fitted  values  produced  by  the  logistic-normal  model.  The  95%  profile  likelihood 
interval  is  (74.8,125.1),  while  the  95%  parametric  percentile  interval  is  (73.6,  114.3). 
The  nonparametric  percentile  and  BCa  intervals  are  (73.8,  120.2)  and  (74.8,  127.4), 
respectively.  Thus,  we  see  much  more  consistency  across  the  different  confidence 
intervals  for  the  simpler  log-linear  model  than  for  the  mixed  model,  the  reason  for 
which  will  be  seen  in  Section  3.5. 

The  log-linear  model  of  mutual  independence  yields  7VC  =  75.1,  profile  likelihood 
interval  (69.9, 83.3),  and  N  =  76.3  with  95%  percentile  percentile  interval  (71.3,  77.9). 
The  95%  nonparametric  percentile  and  BCa  intervals  are  (70.9,  80.3)  and  (71.1,  80.5), 
respectively.  This  model  assumes  no  heterogeneity,  which  yields  narrow  intervals  that 
severely  underestimate  N  when  this  assumption  is  false. 


Table  3.3.  Results  of  capture-recapture  of  snowshoe  hares 
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The  conditional  approach  to  the  two-category  quasi-symmetric  latent  class  model 
yields  Nc  =  77  A.  Table  3.3  shows  the  fit.  The  95%  profile  likelihood  interval  is 
(70.8,87.4).  The  numerical  optimization  approach  yields  N  —  76.3  and  95%  para- 
metric percentile  interval  (72.3,  84.3).  The  95%  nonparametric  percentile  and  BCa 
intervals  are  slightly  wider  at  (72.6,  100.7)  and  (72.0,  91.3).  These  intervals  are  much 
narrower  than  those  produced  by  the  logistic-normal  model,  since  this  latent  class 
model  represents  a  compromise  between  the  naive  mutual  independence  model  and 
the  logistic-normal  model. 

Table  3.4.  iV-Estimates  and  Confidence  Intervals  Produced  by  the  Logistic-normal, 
Quasi-Symmetric  Latent  Class,  Homogeneous  Two-factor  Interaction,  and  Mutual- 
Independence  Models 

bootstrap 


Model 


Nr 


Profile 
Likelihood 


percentile 


BCa 


N       parametric     nonparametric     nonparametric 


LN10 
H02 
QLC 
IND 


92.0  (74.8,148.5) 
90.5  (74.8,125.1) 

77.1  (70.8,87.4) 
75.1  (69.9,83.3) 


89.0  (69.9,129.4)  (70.8,231.5)  (71.8,286.4) 

88.2  (73.6,125.0)  (73.8,120.2)  (74.8,  127.4) 

76.3  (72.3,84.3)  (72.6,100.7)  (72.0,91.3) 
76.3  (71.3,77.9)  (70.9,80.3)  (71.1,80.5) 


This  example  exhibits  typical  variability  among  the  different  point  estimates  and 
confidence  intervals  obtained  from  the  different  models,  and  also  the  variability  among 
the  different  confidence  intervals  for  a  given  model.  These  relationships  and  the 
reasons  behind  them  are  explored  in  the  next  section. 

3.5    Behavior  of  the  Log  Likelihood  and  N  Estimator 


In  the  capture-recapture  problem,  the  estimation  of  a  strongly  affects  the  esti- 
mation of  N.  Large  population  heterogeneity  causes  high  correlations  among  the  t 
captures  and  results  in  a  large  estimate  of  n0...o-  For  the  snowshoe  hare  example, 
Figure  3.1  shows  iV  as  a  function  of  an  assumed  known  value  for  a.  Plot  1  in  that 
figure  shows  results  using  q  =  10, 50,  and  75  quadrature  points.  Since  N  is  a  rapidly 
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increasing  function  of  o,  small  changes  in  a  can  have  a  large  impact  on  the  ML  esti- 
mate of  N.  Plot  2  in  Figure  1  displays  a  profile  of  -2  log  L  in  terms  of  a,  revealing 
that  a  =  0.9,  from  which  we  see  N  =  89.0  in  Plot  1.  These  plots  suggest  that  the 
choice  of  q  affects  the  results  only  for  large  a.  Since  the  maximum  likelihood  estimate 
for  a  is  moderate,  we  obtain  identical  results  for  q  —  10, 50,  and  75. 


N 


0.0 


1.0 


2.0 


-2  Log  L 


200  ■ 
180  ■ 

°  ♦ 

74 
72 

160 

$ 

70 

140 

/ 

68 

120  ■ 
100  • 

y 

66 
64 
62 

80  ■ 

■ ^ — i 1 1 1 

60 

0.0 


1.0 


2.0 


Figure  3.1.  N  and  -2  Log  L  as  a  Function  of  a  for  the  Snowshoe  Hare  Data 


As  heterogeneity  increases  in  model  (3.6),  the  probability  of  capturing  a  subject  a 
relatively  small  or  relatively  large  number  of  times  increases.  Capturing  a  large  num- 
ber of  animals  only  once,  for  instance,  suggests  either  (1)  the  logistic-normal  model 
holds  and  considerable  heterogeneity  exists  within  the  population,  (2)  the  logistic- 
normal  model  holds  and  the  probabilities  of  capture  at  each  occasion  are  small,  or 
(3)  subjects  experience  trap  avoidance  so  that  the  local  independence  assumption 
of  the  logistic-normal  model  is  inappropriate.  Unfortunately,  traditional  goodness- 
of-fit  tests  do  not  always  differentiate  between  a  correct  and  incorrect  model.    We 
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demonstrate  this  difficulty  in  Section  3.7.  This  case  of  large  heterogeneity  causes  dif- 
ficulties in  estimation  when  using  the  logistic-normal  model,  since  a  large  a  results  in 
a  relatively  flat  likelihood  surface,  which  implies  unstable  and  imprecise  iV-estimates. 
This  problem  is  not  serious  with  the  snowshoe  hare  data.  The  profile  likelihood 
surface  with  respect  to  (N,a),  maximized  over  (3,  in  Figure  3.5  shows  a  reasonably 
well-defined  mode,  which  leads  to  a  stable  point  estimate  of  N. 

The  log-likelihood  surface  for  the  snowshoe  hare  data,  however,  is  not  unimodal, 
reflecting  that  many  (N,  a)  pairs  exist  that  have  log-likelihood  values  only  slightly 
lower  than  the  well-defined  maximum  that  defines  N.  This  second  mode  is  reflected 
in  the  large  differences  between  the  parametric  percentile  bootstrap  interval  and  the 
more  robust  (e.g.  nonparametric  percentile  and  nonparametric  BCa)  bootstrap  in- 
tervals. Thus,  the  large  inconsistencies  among  these  intervals  provide  some  clue  that 
many  (N,  a)  pairs  are  consistent  with  the  data.  Because  of  this  near  nonidentifia- 
bility  problem,  the  simpler  log-linear  model  of  homogeneous  two-factor  interaction 
provides  confidence  intervals  narrower  than  those  generated  by  the  logistic-normal 
model  when  a  is  moderate  to  large.  Simulation  results  in  Chapter  5  support  the  use 
of  this  simpler  model  in  these  cases. 

In  contrast  to  the  stable  point  estimates  for  the  snowshoe  hare  data,  consider 
Table  3.5  from  Chao  and  Tsay  (1996a,b),  which  reports  the  results  from  an  epi- 
demiological study  designed  to  estimate  the  number  of  people  infected  during  a  1995 
hepatitis  A  outbreak  in  northern  Taiwan.  The  271  observed  cases  were  reported 
from  3  sources  -  records  based  on  a  serum  test  taken  by  the  Institute  of  Preventive 
Medicine  of  Taiwan  (P),  records  reported  by  the  National  Quarantine  Service  (Q), 
and  records  based  on  questionnaires  conducted  by  epidemiologists  (E). 

For  the  logistic-normal  model,  a  profile  of  N  across  q  reveals  that  the  iV-estimates 
do  not  stabilize  until  q  >  45.  Numerical  integration  yields  a  -  2.6  and  N  =  2204.5 
using  q=\0  and  a  =  2.9  and  N  =  4087.2  using  q  =  50.    Figure  3.2  shows  that 
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Table  3.5.  Capture-history  Counts  and  Conditional  (on  n)  Fitted  Values  for  Hepatitis 
Study 

P  Q  E     m     LN  (q  =  10)     LN  (q  =  50)     LC  (L=2) 


000 

— 

1953.4 

4280.3 

— 

00  1 

63 

61.0 

61.0 

61.0 

01  0 

55 

58.0 

58.0 

58.0 

01  1 

18 

17.0 

17.0 

17.0 

1  00 

C.9 

68.0 

68.0 

68.0 

1  0  1 

17 

20.0 

20.0 

20.0 

1  1  0 

21 

19.0 

19.0 

19.0 

1 1 1 

28 

28.0 

28.0 

28.0 

the  TV-estimates  for  different  q  diverge  as  a  increases,  so  that  at  a  =  2.6,  N  differs 
dramatically  for  different  values  of  q.  As  Aitkin  (1996)  noted,  large  q  is  necessary  in 
random  effect  models  when  a  is  large.  We  also  see  that  the  q  —  10  approximation 
breaks  down  around  a  =  3.  Better  approximations  (q  >  10)  break  down  at  larger 
values  of  a. 
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Figure  3.2.  N  and  -2  Log  L  as  a  Function  of  a  for  the  Hepatitis  Data 
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The  large  a  and  large  negative  values  for  /3  here  reflect  the  many  subjects  with  one 
capture  (187)  compared  with  the  numbers  of  subjects  with  two  or  three  captures  (56 
and  28).  With  such  large  a,  the  data  provide  relatively  little  information  about  TV. 
Figure  3.2,  Plot  2  shows  that  the  hepatitis  data  yields  a  flat  likelihood  with  respect 
to  a,  so  a  wide  range  of  a  values  are  consistent  with  the  data.  The  plausible  a  values, 
however,  correspond  to  a  wide  range  of  TV-estimates,  since  TV  increases  sharply  with 
respect  to  a  (Figure  2,  Plot  1).  For  instance,  a  95%  nonparametric  BCa  interval  for 
TV  is  (786,  85,876). 

We  present  the  hepatitis  log-likelihood  surface  for  comparison  against  the  snow- 
shoe  hare  surface  of  Figure  3.5.  Figure  3.5  illustrates  the  relationship  among  TV,  a, 
and  the  confidence  on  TV,  by  showing  the  profile  log-likelihood  surface  with  respect 
to  TV  and  a  maximized  over  /3,  for  the  hepatitis  data  set.  Nothing  practical  can  be 
said  about  TV  based  on  the  logistic-normal  model  except  that  it  is  not  very  small. 
The  flat  log-likelihood  can  cause  wild  fluctuations  in  the  point  estimate  due  to  small 
changes  in  numerical  precision  or  in  the  data  themselves.  By  contrast,  the  snowshoe 
hare  data  has  a  well-defined  maximum  of  the  log-likelihood  at  (a  —  .9,  TV  =  89.0)  in 
the  range  68  <  TV  <  500.  In  this  case,  the  slope  of  the  surface  in  the  TV  direction  is 
much  steeper  for  small  a  than  for  large  a,  so  that  small  to  moderate  heterogeneity 
produces  narrower  confidence  intervals. 

Why  does  the  logistic-normal  model  sometimes  provide  little  information  about 
the  population  size?  The  reason  is  similar  to  the  reason  why  every  n0...o  >  0  is  plausi- 
ble for  the  quasi-symmetry  model.  A  consequence  of  the  nonparametric  random-effect 
motivation  for  the  quasi-symmetry  model  of  Section  3.1.1  is  that  for  each  candidate 
n0...o,  there  exists  a  mixing  distribution  for  which  the  fitted  value  would  be  that  n0...0. 
The  class  of  possible  mixing  distributions  is  so  rich  that  any  n0...o  is  equally  plausible. 
The  logistic-normal  model  implies  a  marginal  distribution  that  is  a  special  case  of 
the  quasi-symmeiry  model.  This  class  of  mixing  distributions  is  still  rich  enough  that 
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many  values  of  a  may  be  consistent  with  the  data.  A  wide  range  of  plausible  a  val- 
ues means  the  candidate  N  values  form  a  wide  interval,  amounting  to  little  practical 
information  about  N. 

Instead  of  allowing  each  subject  to  have  a  different  propensity  for  capture,  the 
latent  class  approach  requires  Zs  to  be  in  one  of  two  latent  classes,  with  unknown 
probabilities  {vk}.  For  the  hepatitis  example,  Figure  3.3  portrays  the  deviance  profile 
for  the  QLC  model.  The  latent  class  model  also  yields  a  flat  log-likelihood,  yielding 
arbitrary  point  estimate  and  profile  likelihood  interval  (407,  oo). 


0.96+3.84    - 


0.96    - 


r 1 1 1 1 

400        500        600        700        800 


N 


Figure  3.3.  Deviance  (G2)  Profile  for  379  <  N  <  800  for  the  Hepatitis  Data 
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The  flat  log-likelihood  incurred  by  this  model  for  the  hepatitis  data  is  a  result 
of  the  model's  close  relationship  to  the  log-linear  model  of  quasi-symmetry  when 
t  =  3.  Lindsey  et  al.  (1991)  demonstrated  that,  when  k  >  (t  +  l)/2,  the  quasi- 
symmetric  latent  class  fit  is  very  close  to  the  conditional  maximum  likelihood  fit  of 
logistic  model  (3.1).  They  gave  sufficient  conditions  for  these  two  fits  to  be  identical, 
and  term  tables  for  which  this  is  true  as  concordant  tables.  Chao  and  Tsay  (1996a, 
1996b)  note  that  the  true  population  size  for  the  hepatitis  data  is  approximately  545. 
If  we  fit  the  latent  class  model  to  the  complete  data  set,  we  see  that  the  complete 
table  is  concordant  since  the  quasi-symmetric  latent  class  model  yields  the  conditional 
maximum  likelihood  fit  given  by  the  log-linear  model  of  quasi-symmetry  (see  Table 
3.4).  The  unobserved  cell  causes  this  equivalence  to  no  longer  hold  for  all  concordant 
tables,  since  if  it  did,  the  profile  likelihood  interval  would  match  the  quasi-symmetry 
interval  of  (n,oo).  This  relationship  does,  however,  explain  the  small  amount  of 
information  provided  by  the  QLC  model  when  t  =  3.  The  profile  likelihood  lower 
bound,  407.2,  is  only  slightly  larger  than  the  quasi-symmetry  lower  bound  n  =  271. 
We  will  see  the  similarities  between  the  two  models  for  t  =  3  in  Chapter  5.  When 
t  >  3,  one  can  also  obtain  only  a  lower  bound  for  N  from  this  model.  Chapter  5 
will  also  demonstrate  that  if  a  table  does  provide  a  two-sided  interval  for  N,  such  as 
in  the  snowshoe  hare  example,  these  intervals  tend  to  be  narrower  than  the  logistic- 
normal  and  homogeneous  two-factor  interaction  intervals.  These  simulations  will 
show  that  when  the  logistic-normal  model  is  the  true  model,  these  narrower  intervals 
are  optimistic  in  that  their  true  coverage  is  less  than  the  nominal  level. 

Numerical  optimization  for  the  latent  class  model  yields  N  =  476.1.  The  BCa 
bootstrap  (B=1000)  interval  is  (408.3,573.6),  even  though  the  log-likelihood  is  ex- 
tremely flat.  This  is  a  major  disadvantage  of  the  bootstrap  in  that  it  may  not  rec- 
ognize the  extremely  flat  log-likelihoods  associated  with  a  model.  Figure  3.4  shows 
why  this  happens.    This  figure  plots  -2  Log  L  as  a  function  of  N  for  the  observed 
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Figure  3.4.  -2  Log  L  Profile  for  the  Observed  Hepatitis  Data  (Solid  Line)  and  Four 
Resampled  Tables  (Dashed  Line) 

hepatitis  data  (solid  line)  and  for  four  tables  obtained  by  resampling  from  the  ob- 
served data.  We  remark  that  the  values  on  the  -2  Log  L  axis  are  not  the  true  values 
for  the  resampled  profiles.  Rather,  these  profiles  are  overlayed  on  the  plot  for  the 
observed  data,  since  we  are  simply  interested  in  relaying  (1)  the  iV-estimates  that 
are  produced  at  the  minimum  of  the  four  resampled  profiles,  and  (2)  the  fact  that 
the  profiles  are  extremely  flat  and  never  exceed  the  minimum  value  +  \\  05 •  We  see 
that  the  minimum  -2  Log  L  value  for  the  resamples  are  shifted  somewhat  away  from 
the  observed  value,  but  that  the  resampled  statistics  iV6*  =  (423.6, 443.4, 547.5, 629.7) 
ignore  the  flat  log-likelihoods  associated  with  the  observed  and  resampled  tables. 


64 

Thus,  one  can  obtain  a  maximum,  N,  and  bootstrap  from  this  estimate  to  obtain 
a  confidence  interval  even  though  almost  all  values  of  the  missing  cell  count  are 
consistent  with  the  model.  In  fact,  simulations  in  Chapter  5  demonstrate  that,  for 
/.  =  3,  the  narrow  percentile  intervals  from  the  QLC  model  provide  close  to  0% 
coverage,  while  the  profile  likelihood  intervals  with  upper  bound  oo  provide  coverage 
close  to  nominal.  Of  course,  these  intervals  provide  very  little  practical  information 
on  the  population  size. 

3.6     Similarities  to  Other  iV-Estimation  Problems 

Flat  log-likelihoods  have  arisen  in  other  capture-recapture  approaches.  Burnham 
and  Overton  (1978)  made  a  passing  reference  to  the  perfomance,  in  this  respect,  of 
the  beta-binomial  model,  and  they  presented  the  jackknife  estimators.  Chao  (1987), 
however,  presented  simulation  results  that  showed  very  poor  coverage  probabilities  of 
this  estimator  when  t  is  small  to  moderate  (i.e.  t  <  10). 

Similarities  exist  between  this  problem  and  the  related  problem  of  iV-estimation 
when  observing  k  independent  and  identically  distributed  binomial  counts  with  un- 
known N  and  success  probability  p;  see,  for  instance,  Olkin  et  al.  (1981),  Casella 
(1986),  and  Aitkin  and  Stasinopoulos  (1989).  Aitkin  and  Stasinopoulos  (1989)  demon- 
strated flat  likelihoods  for  certain  configurations  of  data  that  provide  little  information 
about  N.  All  these  authors  demonstrated  that  when  the  log  likelihood  is  flat,  the  ML 
estimator  is  unstable,  with  small  changes  in  the  data  yielding  large  changes  in  N.  For 
the  hepatitis  data,  we  notice  that  N  changes  from  3194.3  to  3816.2  to  4599.5  when 
»(i,...,i)  changes  from  27  to  28  to  29.  Olkin  et  al.  (1981)  proposed  new  estimators 
that  "stabilize"  the  ML  estimate,  also  by  jackknifing,  but  which  often  result  in  the 
underestimation  of  N  in  stable  cases  (Casella,  1986). 
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3.7    Comments 

Fitting  a  variety  of  models  to  the  snowshoe  hare  data  and  hepatitis  data  demon- 
strates that  different  models  can  produce  dramatically  different  point  and  interval 
estimates  of  population  size.  This  is  because  the  problem  of  estimating  the  unob- 
served cell  count  no...o  is  inherently  one  of  extrapolation.  Knowing  the  true  value  of 
«o...o  =  274  for  the  hepatitis  data  allows  us  to  investigate  the  fits  of  these  models  to 
the  complete  table.  Table  3.6  displays  the  fits  of  the  logistic-normal  (a  profile  along 
q  indicates  that  q  =  10  is  sufficient  for  the  complete  table)  and  the  latent  class  model 
to  the  complete  table.  The  logistic-normal  model  does  not  fit  the  complete  table  well, 
since  G2coinplete  =  9.3  with  df  =  3.  The  latent  class  model,  on  the  other  hand,  has 
^complete  =  1-0  with  df  =  2  for  the  complete  table.  Indeed,  the  latent  class  model 
has  a  biologically  plausible  interpretation  for  the  hepatitis  data  set.  The  population 
can  be  divided  into  two  groups:  one  that  is  susceptible  to  the  virus  and  one  that  is 
relatively  immune.  Compare  to  Table  3.5.  We  cannot  discern  the  difference  in  fits 
from  the  incomplete  table,  since,  conditional  on  n,  both  models  produce  identical  fits. 
This  reflects  the  fact  that  usual  goodness-of-fit  criteria  are  not  appropriate  for  this 
extrapolation  problem.  This  also  suggests  that  models  that  have  poorer  fits  to  the 
complete  table  could  potentially  have  an  adequate  fit  for  the  unobserved  cell  so  as 
to  produce  a  confidence  interval  that  contains  the  true  N.  So  models  with  a  poor 
conditional  fit  cannot  be  excluded  from  consideration.  We  demonstrate  using  a  24 
table  resulting  from  the  cross-classification  of  263  individuals  according  to  whether  or 
not  they  contracted  influenza  during  4  influenza  outbreaks.  This  data  is  considered 
in  detail  in  Chapter  4.  For  now,  we  simply  note  that  the  logistic-normal  (q  =  10) 
fit  to  the  complete  table  yields  deviance  G2comvlete  =  27.7  based  on  df=10,  provid- 
ing strong  evidence  of  lack-of-fit.  However,  if  we  pretend  that  n0ooo  is  unknown  and 
estimate  N  using  the  logistic-normal  model,  we  also  obtain  evidence  of  lack  of  fit 
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with  Gfnamplete  =  26.5  based  on  df=9,  but  obtain  TV-estimate  7VC  =  204.2  and  profile 
likelihood  interval  (170.9,  388.0).  Thus,  subject  matter  knowledge  of  the  capture- 
recapture  application  becomes  important  in  assessing  the  performance  of  different 
model-based  estimators. 

Table  3.6.  Capture-history  Counts  and  Fitted  Values  for  Compete  Hepatitis  Table 
P  Q  E        m        LN  (g  =  10)     QLC  (L=2) 
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Since  the  standard  techniques  for  model  selection  based  on  goodness-of-fit  criteria 
can  give  misleading  results  in  this  setting,  we  recommend  an  exploratory  data  analy- 
sis approach  to  modelling  capture-recapture  data,  instead  of  rejection/acceptance  of 
models  based  on  goodness-of-fit  criterion.  We  recommend  looking  at  several  models 
(such  as  logistic-normal  with  various  q,  latent  class  models,  and  log-linear  models) 
simultaneously  along  with  profile  log-likelihood  plots  for  the  models  and  variance  com- 
ponent and  item  parameter  estimates  from  the  logistic-normal  model.  Simulations  in 
Chapter  5  will  show  that  when  the  logistic-normal  model  fit  yields  a  large  estimated 
variance  component  and  flat  log-likelihood  surface,  the  simpler  log-linear  model  of 
homogeneous  two  factor  interaction  is  preferable.  The  simulations  suggest  that  even 
if  the  true  model  is  the  logistic-normal  model,  the  simpler  log-linear  model  is  compet- 
itive with  the  true  model  with  respect  to  confidence  interval  coverage  and  superior 
with  respect  to  interval  width  if  the  logistic-normal  model  yields  a  flat  log-likelihood. 


CHAPTER  4 
ALTERNATIVE  FORMS  OF  DEPENDENCE 


In  fitting  the  logistic-normal  model  of  Section  3.1.2,  we  assume  that  the  t  responses 
are  independent  for  a  given  subject.  This  assumption  implies  that  any  observed  de- 
pendencies among  the  t  samples  are  due  solely  to  population  heterogeneity.  In  other 
words,  these  models  assume  that  a  positive  association  among  sampling  occasions  is 
not  caused  by  the  fact  that  capture  on  the  first  occasion  increases  a  subject's  probabil- 
ity of  capture  on  the  second,  but  rather  that  capture  on  the  first  occasion  indicates  an 
above-average  susceptibility  to  capture  and  hence  an  above-average  chance  of  capture 
on  the  second  occasion. 

In  this  chapter,  we  investigate  models  that  relax  this  strong  assumption.  We 
first  consider  models  that  assume  serial,  or  Markov,  dependence  among  the  t  cap- 
tures. These  models  make  sense  when  the  occasions  are  ordered  in  time,  since  the 
probability  of  capture  at  occasion  j  depends  on  capture  status  at  occasion  j  —  1,  for 
j  =  2, . . . ,  t.  Thus,  these  models  are  often  appropriate  in  animal  abundance  studies 
in  which  the  sampling  occasions  are  trappings  conducted  sequentially  in  time  and 
a  subject  experiences  trap  "avoidance"  or  trap  "dependence."  These  methods  are 
not  appropriate  for  epidemiological  data  arising  from  t  lists  or  records  of  subjects 
with  a  certain  condition,  such  as  the  hepatitis  data  of  Section  3.5,  since  the  sampling 
occasions  are  not  ordered.  In  such  settings,  it  is  reasonable  to  incorporate  a  depen- 
dence structure  that  is  symmetric  with  respect  to  the  t  occasions.  In  Section  4.1,  we 
describe  this  structure,  which  provides  an  alternative  motivation  for  the  log-linear 
model  of  homogeneous  two-factor  interaction  of  Section  3.1.1. 
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Sections  4.2  and  4.3  investigate  two  alternative  random-effect  models  that  allow 
for  dependence  structures  that  are  more  general  than  that  implied  by  the  logistic- 
normal  model.  Section  4.2  presents  a  model  for  capture-recapture  that  adds  a  normal 
random  effect  to  the  linear  predictor  of  the  log-linear  model  of  mutual  independence. 
This  random  effect  models  an  observed  table's  departure  from  the  simple  mutual- 
independence  structure.  We  use  an  EM  algorithm  to  fit  this  model  conditional  on  the 
number  of  subjects  observed,  and  investigate  the  use  of  profile  likelihood  confidence 
intervals  for  this  model.  Section  4.3  presents  a  model  that  is  potentially  useful  when 
one  has  reason  to  believe  that  capture  status  at  two  or  more  occasions  are  negatively 
correlated,  such  as  the  situation  of  trap  "avoidance".  This  model,  which  we  term  the 
multivariate  logit-normal  model,  is  a  binary  analogue  of  Aitchison  and  Ho's  (1989) 
Poisson  log-normal  model  for  multivariate  count  data.  To  our  knowledge,  this  binary 
analogue  has  not  been  addressed  in  the  statistical  literature. 

4.1     Serial  Dependence 

Serial  dependence  occurs  when  the  probability  of  capture  at  time  j  depends  on 
the  capture  status  at  time  j  -  \,  j  =  2,. .  .,t.  Duncan  (1985)  and  Conaway  (1990) 
presented  a  generalization  of  subject-specific  logistic  model  (3.1)  that  relaxes  the  local 
independence  assumption.  As  in  the  local  independence  case,  the  CML  approach  pro- 
vides no  information  on  population  size.  We  therefore  investigate  models  that  remove 
the  requirement  of  main  diagonal  saturation,  and  generalize  these  serial  dependence 
models  to  situations  when  the  "sampling  occasions"  are  not  ordered  in  time. 
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4.1.1     Sequential  Sampling  Occasions 

Duncan  (1985)  and  Conaway  (1989)  incorporated  serial  dependence  with  the 
model 

p(y»M  = ,  -^t   ,    — — ,  (4.i) 

where  Ss  is  the  total  number  of  captures  for  subject  s  and  hs  is  the  number  of  adjacent 

(in  time)  pairs  of  samples  that  have  concordant  responses  for  subject  s.  The  serial 

dependence  parameter  7  reflects  within-subject  dependence  among  the  t  occasions. 

Thus,  trap-avoidance  results  in  a  negative  7  value  while  trap-dependence  results  in  a 

positive  7  value.  Analogous  to  the  results  for  the  logistic  model  of  Section  3.1.1,  the 

CML  approach  leads  to  the  log-linear  model, 

t 
log(^,...n)  =  £  Pjij  +  A(ii, . . . ,  it)  +  D(iu  . . . ,  it) j,  (4.2) 

i=i 

for  the  2*  table,  where  A(ii, . . . ,  it)  is  invariant  to  permutations  of  its  argument  and 

D(iu  ...,it)  =  »1»2+(l-»l)(l-»2)+*2*3+(l-*2)(l-*3)+-  •  '+«(t-l)it+(l-*(t-i))(l-»t). 

(4.3) 
Like  its  local  independence  analogue,  this  model  does  not  provide  population  size 
estimates  since  the  A(0, . . . ,  0)  parameter  forces  a  perfect  fit  for  the  0  =  (0, ... ,  0) 
cell.  We  examine  two  simpler  models  that  provide  population  size  estimates. 

Serial  Dependence  Assuming  No  Heterogeneity 

The  first  model,  that  of  serial  dependence  (SE)  assuming  no  heterogeneity  in  the 
population,  results  from  dropping  the  \(iu  ...,it)  parameters  from  model  (4.2).  The 
model  is 

t 

log(/v..J  =  J2  Pih  +  D{iu. . . ,  it)-f.  (4.4) 
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Table  4.1.  Column  of  the  covariate  matrix  corresponding  to  u  in  model  (4.5)  for  the 
models  of  homogeneous  2-factor  interaction  and  serial  dependence  when  t  =  3 


(ii...*«)     (EjVM     D(i,,i2,i3) 
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This  model  accounts  for  dependencies  among  the  t  responses  by  the  addition  of  the 
extra  parameter  7.  Both  this  model  and  the  log-linear  model  of  homogeneous  two- 
factor  interaction  have  form 


log(Ai)  =  [X2«xt:xHi](  f  ),  (4.5) 


where  X2<xt  is  the  covariate  matrix  corresponding  to  the  mutual  independence  model, 
a;  is  7  in  the  serial  dependence  model  and  A  in  the  homogeneous  2-factor  interaction 
model.  The  only  difference  between  the  two  models  is  the  column  of  the  covariate 
matrix,  xt+1,  that  corresponds  to  u.  Table  4.1  displays  xt+1  associated  with  7  and  A 
for  the  two  models  when  t  =  3. 

We  see  that  the  serial  dependence  model  smooths  the  fitted  value  for  cell  0  towards 
the  value  of  cell  1  =  (1, . . . ,  1)  much  more  than  the  homogeneous  2-factor  interaction 
model,  since  both  cell  0  and  cell  1  have  the  largest  number,  t,  of  adjacent  concordant 
pairs.  This  is  in  contrast  to  the  homogeneous  two-factor  interaction  model,  which 
smooths  this  unknown  count  towards  those  cells  corresponding  to  one  capture.  Thus, 
when  most  subjects  are  captured  on  only  one  sampling  occasion,  the  serial  dependence 
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model  produces  smaller  population  size  estimates  than  the  H02  model  since  the 
number  of  subjects  captured  at  all  t  occasions  is  small. 

To  illustrate,  we  fitted  the  serial  dependence  model  to  the  snowshoe  hare  data 
of  Section  3.4.  The  model  yields  point  estimate  Nc  =  74.6  and  corresponding  95% 
profile  likelihood  interval  (69.5,  83.8).  These  results  are  very  close  to  the  mutual 
independence  results  of  Nc  =  75.1  and  (69.9,83.3)  because  7  =  -.039  is  close  to 
zero  relative  to  variability  in  D.  The  serial  dependence  fit  yields  G2  —  58.2  based  on 
df=55,  while  the  mutual  independence  model  yields  G2  —  58.3  on  df=56.  Simulations 
in  Chapter  5  will  show  that  the  addition  of  this  dependence  parameter  improves 
upon  the  mutual  independence  model  slightly  by  yielding  confidence  intervals  that 
are  slightly  wider  than  the  mutual  independence  intervals.  Chapter  5  shows  that  as  a 
result,  when  the  logistic-normal  model  truly  holds,  these  intervals  improve  upon  the 
poor  coverage  of  the  mutual  independence  intervals  somewhat,  but  are  also  overly 
optimistic  when  large  amounts  of  heterogeneity  exist  in  the  population.  This  is  not 
surprising  since  we  obtained  the  model  by  dropping  the  X(ii,...,it)  heterogeneity 
parameters  from  model  (4.2). 

Mixed  Serial  Dependence  Model 

We  also  investigate  the  performance  of  the  mixed  model  that  results  from  assum- 
ing as  =  aZs  in  model  (4.1),  where  Zs  !~'  N(0, 1).  This  extends  the  logistic-normal 
model  of  Section  3.1.2  to  allow  for  within-subject  dependence.  The  quadrature  ap- 
proximations to  the  marginal  cell  probabilities  for  this  model  have  the  form 


7rti...it  —  2^ 


t  r    e(<™*s<i-..<t+]Cj..i0.*v+i*<i-»*«) 
fe=1   £e("*s*i  ■■■*(+£{■=!  &v+i**i--.<») 


Vk,  (4.6) 
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where  5^...^  and  h^^  are  the  raw  score  and  serial  dependence  value,  respectively, 
associated  with  cell  i  =  (i\, . . .  ,it).  It  is  worthwhile  to  investigate  under  what  con- 
ditions the  addition  of  the  serial  dependence  parameter  improves  the  coverage  of  the 
simpler  logistic-normal  model  and  to  compare  the  lengths  of  the  confidence  intervals 
produced  by  the  two  models.  We  investigate  these  questions  through  simulation  in 
Chapter  5. 

This  random-effects  approach  to  model  (4.1),  like  the  logistic-normal  model,  can 
also  yield  flat  log-likelihood  surfaces  with  respect  to  N.  For  instance,  for  the  snowshoe 
hare  data  set,  this  approach  yields  Nc  =  337.7  and  95%  profile  likelihood  interval 
(75.7,476.4).  So,  again,  the  inclusion  of  a  random  effect  results  in  a  model  that  may 
provide  little  information  about  the  population  size. 

Serial  Dependence  +  Homogeneous  Two-Factor  Interaction 

Mimicking  the  developments  in  Section  3.1.1  that  motivated  the  log-linear  model 
of  homogeneous  two-factor  interaction,  we  obtain  a  second  serial  dependence  model, 
which  we  denote  by  H02SE,  by  replacing  the  A(*i, . . . ,  it)  parameters  in  model  (4.2)  by 

the  homogeneous  two-factor  interaction  dependence  term,  I       ^  %i  ] .  This  yields 

the  model 

log(/^..,t)  =  £  fify  +  (  E5'=!  lj  )  A  +  D(iu . . . ,  it)7,  (4.7) 

where  as  before  D(iu  . . .  ,it)  has  form  (4.3).   The  log-linear  model  of  homogeneous 
two-factor  interaction  is  the  special  case  of  this  model  with  7  =  0. 

To  illustrate,  we  fit  this  model  to  the  snowshoe  hare  data.  This  model  yields 
iV-estimate  Nc  =  92.3  and  95%  profile  likelihood  interval  (75.5,130.1).  This  model 
provides  similar  results  to  the  log-linear  model  of  homogeneous  two-factor  interac- 
tion since  7  =  -.34.  Unfortunately,  we  cannot  interpret  this  estimate  as  a  reflection 
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of  the  within-subject  dependence  between  the  t  responses,  since  this  within-subject 
dependence  and  the  dependencies  resulting  from  population  heterogeneity  are  con- 
founded (Darroch  and  McCloud  1990).  To  see  this,  note  that,  under  model  (4.7), 
the  conditional  odds  ratios  are  equal  to  A  +  27.  Including  this  serial  dependence 
parameter  into  the  model,  however,  can  be  worthwhile  when  estimating  N.  Simula- 
tions in  Chapter  5  show  that,  when  both  within-subject  dependencies  and  population 
heterogeneity  exist,  model  (4.7)  maintains  close  to  nominal  coverage  in  those  cases 
when  the  log-linear  model  of  homogeneous  two-factor  interaction  produces  intervals 
with  coverage  lower  than  the  nominal  level.  Chapter  5  will  also  demonstrate  that 
the  logistic-normal  model  seriously  overestimates  N  when  subjects  in  the  population 
experience  trap  avoidance.  Thus,  if  one  suspects  trap  avoidance  in  the  form  of  a 
negative  7  in  model  (4.1),  model  (4.7)  is  an  attractive  alternative  for  estimating  the 
population  size.  We  now  provide  an  alternative  motivation  for  the  log-linear  model 
of  homogeneous  2-factor  interaction  by  generalizing  model  (4.7)  to  the  situation  of 
unordered  sampling  occasions. 

4.1.2    Unordered  Sampling  Occasions 

The  two  models  in  the  previous  section  do  not  apply  to  the  hepatitis  data  set 
because  the  three  "sampling  occasions,"  lists  of  patients  contracting  hepatitis  A,  are 
not  sequential.  We  now  extend  the  models  of  the  previous  section  to  treat  the  t  oc- 
casions symmetrically.  We  define  alternative  dependence  covariates,  Dsym(i\, . . . ,  it), 
that,  instead  of  considering  only  adjacent  pairs  of  occasions,  treat  all  occasion  pairs 
equally.  Specifically, 

Dsy>n{iu...,it)  =  M2  +  (i-*'i)(i-*2)  +  »i»s  +  (i-«i)(i-*3) 

+  •  •  •  +  it_xit  +  (1  -  it-i)(l  -  it), 


74 


Table  4.2.  Column  of  the  Covariate  Matrix  Corresponding  to  A  in  the  Homogeneous 
Two- Factor  Interaction  Model  and  7  in  models  (4.8)  and  (4.9) 
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so  that  the  symmetric  versions  of  models  (4.4)  and  (4.7)  are 


log(/ii,..J  =  £  PA  +  DSVm(h>  •  •  • ,  ith- 


(4.8) 


and 


log(/i,1,...,it)  =  ^/Vj  + 


Ej=i  ij 


\ +  &-&,...  Aft, 


(4.9) 


respectively.   Table  4.2  displays  Dsym(i1,i2,i3)  values  along  with  the  column  of  the 
covariate  matrix  corresponding  to  A  in  the  H02  model  for  t  =  3. 
We  notice,  however,  that  this  symmetric  dependence  term  satisfies 

Dsym(iui2,  is)  =  3  -  2ix  -  2i2  -  2*3  +  (  Ej3f ij  )  , 
and  more  generally, 


D—ih,:.,*) 


2E»i  + 


i=i 


Sj=i  ij 
2 


Thus,  given  the  marginal  indicators,  iu...Jt,  the  symmetrical  dependence  parameter 
7  is  aliased  with  the  A  term  in  the  H02  model.  Therefore,  both  models  (4.8)  and  (4.9) 
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are  equivalent  to  the  log-linear  model  of  homogeneous  two-factor  interaction.  So,  the 
log-linear  model  of  homogeneous  two-factor  interaction  postulates  the  dependence 
structure  as  a  symmetric  one  when  there  is  no  ordering  among  the  t  occasions. 

4.2     An  Overdispersed  Poisson  Log-Linear  Model 

Chapter  5  shows  that  when  population  heterogeneity  is  present,  ignoring  this  het- 
erogeneity by  fitting  the  log-linear  model  of  mutual  independence  to  the  incomplete 
table  produces  overly-optimistic,  narrow  confidence  intervals  that  systematically  un- 
derestimate N.  In  this  section,  we  pursue  a  more  general  Poisson  model  that  accounts 
for  a  table's  departure  from  mutual  independence  by  adding  a  normal  random  effect 
with  0  mean  and  unknown  variance,  a2,  on  the  log  scale.  This  model  differs  from  the 
logistic-normal  model  since  it  postulates  the  random  deviations  from  mutual  depen- 
dence as  being  at  the  cell  level,  instead  of  the  subject  level. 

There  are  both  advantages  and  disadvantages  of  this  model  for  capture-recapture. 
The  model  is  more  general  than  the  independence  model,  and  the  addition  of  the  ran- 
dom effect  produces  confidence  intervals  for  N  that  are  wider  than  the  independence 
interval.  These  intervals,  however,  require  more  computation.  A  sufficiently  large 
number  of  quadrature  points  must  be  employed  when  approximating  the  marginal 
log-likelihood  in  order  to  obtain  a  continuous  profile  of  the  deviance  with  respect  to 
N  that  yields  a  profile  likelihood  interval. 

Section  4.2.1  presents  the  model,  while  Section  4.2.2  describes  an  EM  algorithm 
for  fitting  the  model.  Section  4.2.3  demonstrates  the  advantages  and  disadvantages 
of  the  model  for  capture-recapture  by  fitting  the  model  to  the  snowshoe  hare  and 
hepatitis  data  sets  of  Chapter  3. 
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4.2.1  An  Overdispersed  Log-Linear  Model 

The  log-linear  model  of  mutual  independence  for  a  2*  table  models  the  expected 
frequencies,  {//;}  =  {/*,■,...<«}>  as 

log(/x,)  =  A)  +  A/(»,  =  1)  +  . . .  +  0J(it  =  1).  (4.10) 

Instead  of  adding  association  parameters  to  the  model,  we  model  an  observed  table's 
departure  from  the  mutual  independence  model  as  overdispersion.  Specifically,  the 
model  has  form 

log(/ii)  =  &  +  Ami  +  .  ■  •  +  Al/it  +  erZ,, 

where  Zj  '~'  7V(0, 1).  Thus,  /j,-,  is  assumed  to  have  a  log-normal  distribution  with 
mean  fio  +  PiVn  +  •  •  •  +  PtVu  and  variance  a2,  yielding  a  Poisson-lognormal(/?0  + 
PiVn  +  •••  +  PtViu  c2)  model  for  the  cell  counts. 

This  model  contains  the  mutual  independence  model  as  a  special  case  with  a  =  0. 
The  variability  associated  with  the  random  effect  will  result  in  wider  confidence  inter- 
vals for  N,  alleviating  the  problem  of  extremely  narrow  confidence  intervals  caused  by 
the  overly  simplistic  mutual  independence  assumption.  Since  any  extra  variation  be- 
yond that  specified  by  the  mutual  independence  model  is  modelled  on  the  same  scale 
as  the  linear  predictor,  this  approach  is  often  employed  in  generalized  linear  models 
when  there  is  more  variability  than  predicted  by  the  model  due  to  the  omission  of 
covariates.  We  next  consider  standard  methods  to  fit  this  model. 

4.2.2  Estimation 

Like  the  generalized  linear  mixed  models  that  incorporate  a  random  effect  to 
account  for  dependence  within  clusters  of  observations,  such  as  the  logistic-normal 
model  of  Section  3.1.2,  overdispersed  generalized  linear  mixed  models  that  include 
a  random  effect  for  each  observation  are  also  computationally  difficult  to  fit  using 
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maximum  likelihood.  These  models  also  produce  marginal  log-likelihoods  that  do  not 
have  closed  form,  again  making  Gauss-Hermite  quadrature  necessary  when  assuming 
a  normal  random  effect.  We  use  the  EM  algorithm  described  by  Anderson  and  Hinde 
(1988)  and  Aitkin  (1996).  The  form  of  the  EM  algorithm  is  similiar  to  that  of  the 
EM  algorithm  detailed  in  Section  3.1.2  for  fitting  the  logistic-normal  model  to  the 
complete  table,  although  that  algorithm  is  slightly  simpler  since  we  can  reduce  the 
data  down  to  the  expected  number  of  successes  and  trials  for  a  given  value,  zk,  of  the 
random  effect.  For  the  overdispersed  Poisson  model,  we  must  fit  a  response  vector  of 
length  2*  x  q,  where  again  q  is  the  number  of  quadrature  points. 

We  proceed  by  following  Aitkin  (1996).   Consider  the  marginal  log-likelihood  of 

l(P,  a;  n)  =  ]£  log  (I  /(nj|/3,  a,  z^z^dzA  , 


where 


/(„,|/j,  a,  *)  =  !-£-, 


ml 

and  yUj  is  specified  by  the  model, 

Hi  =  exp(/50  +  /3iyn  +  ■■■  +  PtVu  +  <tZ\)> 
5-point  Gaussian  quadrature  yields  the  approximation 


1{P,  a;  n)  «  £  log  I  £  i/kfik  )  , 


— « 


where  f-lk  is  the  Poisson  density  for  n\  given  value  zk  for  the  random  effect.  Compare 
with  expression  (3.13).  Proceeding  as  in  Section  3.1.2  and  using  identity  (3.15),  a 
/^-element  of  the  score  vector  has  form 


dl      ^^      vkf\k      dlog/ifc      v-A  ,a. 
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where 


Wik 


Vkf\ 


\h 


and  Sik{P)  is  simply  the  /3-element  of  the  score  vector  corresponding  to  the  generalized 
linear  model 

log(Mifc)  =  A)  +  Alto  +  •  •  •  +  Ptm  +  °Zk- 


Similarly, 


dl  q 


Setting  the  score  vector  equal  to  zero  yields  likelihood  equations  corresponding  to  the 
weighted  generalized  linear  model 


log  (E  [n9] )  {2t  x  q)  x  j  =  V(2«  x  ?)  x  (t+2)  7(t+2)  x  i 


with  prior  weights  w  =  (wn,  u>2i,  •  ■  ■ ,  W2f(g-i)5  ^'(g)),  where 


n?2<xa)xi  =  (n,n,...,n)', 


(4.11) 


(2fx9)x(t+2) 


X     Zil2t 
X      Z21.2* 


X    zgl2( 


X2'x(t+i)  is  the  design  matrix  for  the  mutual  independence  model  (4.10),  and  7(t+2)xi 

=  (/3,  a). 

This  representation  suggests  the  iterative  procedure  that,  at  iteration  (p  +  1), 
computes  the  prior  weights  w(p+1)  for  given  parameter  estimates  7W,  and  obtains 
updated  estimates  jb+V  by  fitting  model  (4.11)  to  the  expanded  data  vector  n9. 
Anderson  and  Hinde  (1988)  show  that  this  algorithm  takes  the  form  of  an  EM  algo- 
rithm that  considers  the  joint  distribution  of  (n,  Z)  as  the  complete  data  and  n  as  the 
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incomplete  data.  The  computation  of  the  prior  weights,  given  parameter  estimates 

7^,  corresponds  to  the  E-step  that  computes  the  conditional  expectation,  Q(j\y^), 
of  the  complete  log-likelihood  given  the  observed  data  and  the  parameter  estimates 
from  iteration  p.  The  fitting  of  the  weighted  generalized  linear  model  (4.11)  maxi- 
mizes this  conditional  expectation  with  respect  to  7,  constituting  the  M-step  of  the 
EM  algorithm.  One  can  take  (3  obtained  from  the  mutual  independence  model  and 
and  ct  /  0  as  the  initial  estimates  for  the  algorithm.  We  terminate  the  algorithm 
when  the  difference  between  deviances  of  successive  fits  is  sufficiently  small. 

We  compute  the  residual  deviance  of  the  overdispersed  Poisson  fit  by  comparing 
the  resulting  maximum  weighted  log-likelihood  under  this  model  against  that  for  the 
saturated  fit: 


G2  =  -2 


5>g  IE  &*-*** 


;,  =  ! 


-2  5>,(log(n,)-l)] 


We  use  the  deviance  to  construct  profile  likelihood  surfaces  with  respect  to  the  un- 
known cell  count  no...o  for  capture-recapture. 

4.2.3     Application  to  Capture-Recapture 

We  now  apply  this  overdispersed  Poisson  model  to  capture-recapture  using 
Sanathanan's  conditional  (on  n)  methods  of  Section  2.2.1.  We  have  noted  that  this 
approach  yields  the  estimate  no...o  that  yields  minimum  G2.    We  first  obtain  this 
minimum  G2  value  by  fitting  the  model  while  assigning  count  n0...o  weight  0,  just  as 
we  would  when  fitting  a  standard  log-linear  model. 

For  the  hepatitis  data  using  10-point  Gaussian  quadrature,  we  obtain 

inf     G2(n0  „)  =  18.64. 

n0...o€R+ 

Thus,  we  attempt  to  construct  a  profile  likelihood  interval  for  N  that  contains  all 
values  n  +  n0...o  =  271  +  n0...o  for  which  the  residual  deviance  of  the  complete  table 
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fit  is  less  than  18.64  +  3.84  =  22.48.  We  obtain  a  profile  of  these  residual  deviance 
values  by  searching  across  0  <  no...o  <  500,  with  the  understanding  that  we  may  have 
to  investigate  larger  n0...o  values  if  the  corresponding  deviances  are  all  less  than  or 
extremely  close  to  this  cutoff  value.  Using  a  convergence  criterion  of  .0001  for  the 
change  in  sucessive  deviances,  the  maximum  number  of  EM  iterations  performed  for 
a  particular  value  of  N  was  48  when  N  =  338. 
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Figure  4.1.  Deviance  (G2)  as  a  Function  of  N  for  the  Overdispersed  Poisson  Model 
(q=10)  Applied  to  the  Hepatitis  Data 


Figure  4.1  shows  the  resulting  deviance  profile  with  a  horizontal  dotted  line  de- 
noting the  acceptable  deviance  cutoff  value  of  22.48.  We  see  that  when  q  =  10,  unlike 
the  standard  log-linear  and  random  effects  models  of  Chapter  3,  this  profile  is  neither 
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continuous  nor  does  it  have  convex  shape  near  its  minimum.  Instead,  we  obtain  a 
confidence  set  that  is  not  an  interval,  since  N  €  (297,  530)  and  N  €  (710, 743)  satisfy 
G2  <  22.48. 
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Figure  4.2.  Deviance  (G2)  as  a  Function  of  N  for  the  Overdispersed  Poisson  Model 
(q=15)  Applied  to  the  Hepatitis  Data 


Figures  4.2  and  4.3  plot  the  deviance  profiles  for  15-  and  20-point  quadrature, 
respectively.  Comparing  these  plots  to  10-point  quadrature  suggests  that  the  irregular 
behavior  of  the  G2  profile  when  q  —  10  is  a  result  of  the  quadrature  approximation. 
The  better  approximations  produce  much  smoother  functions  of  G2  as  a  function  of  N, 
yielding  interval  estimates  for  N.  This  suggests  that  we  may  require  a  large  number  of 
quadrature  points  to  obtain  a  deviance  profile  that  provides  the  appropriate  interval 
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Figure  4.3.  Deviance  (G2)  as  a  Function  of  TV  for  the  Overdispersed  Poisson  Model 
(q=20)  Applied  to  the  Hepatitis  Data 

estimate  of  the  population  size.  When  9  =  15, 


inf     G2(n0  o)  =  19.68 

n0...o6R+ 


and  we  obtain  the  95%  confidence  interval  (300,  560)  for  N.  We  obtain  similar  results 
when  q  —  20,  with 

inf     G2(n0...o)  =  19.81 

no...oefl+ 

and  (295,  561).  Both  of  these  more  accurate  approximations  yield  intervals  that  are 
much  wider  than  (351.5,  437.1),  the  mutual  independence  interval  obtained  when 
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ignoring  population  heterogeneity.  Thus,  the  introduction  of  a  random  effect  for 
each  cell  in  the  2*  table  introduces  uncertainty  for  TV  beyond  that  induced  by  the 
mutual  independence  model.  This  additional  uncertainty  produces  wider  confidence 
intervals  for  TV.  For  the  hepatitis  data  set,  this  wider  interval  contains  545,  the  true 
population  size.  In  addition,  this  mixed  model  does  not  incur  the  extremely  flat 
likelihoods  encountered  by  the  logistic-normal  model  in  this  example. 
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Figure  4.4.  Deviance  (G2)  as  a  Function  of  TV  for  the  Overdispersed  Poisson  Model 
Applied  to  the  Snowshoe  Hare  Data 


We  also  analyzed  the  snowshoe  hare  data  with  this  overdispersed  Poisson  model  for 
q  =  10.  The  point  estimate,  TVC  =  75.0  and  the  profile  likelihood  interval,  (70,83), 
for  TV  match  the  results  of  the  mutual  independence  model  for  this  case.    This  is 
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because  the  estimate  of  the  random  effect  standard  deviation,  a  =  .007,  is  close  to 
zero.  Thus,  the  maximum  likelihood  fit  of  the  mixed  model  is  essentially  the  special 
case  of  mutual  independence.  Figure  4.4  shows  the  profile  of  G2  for  this  model.  Note 
that  with  such  a  small  estimated  dispersion  parameter,  q  =  10  quadrature  points  is 
sufficient  and  we  obtain  a  smooth  profile  of  the  deviance. 

4.3     The  Multivariate  Logit-normal  Model 

The  use  of  a  subject-specific  random  effect  in  the  logistic-normal  model  imposes 
a  correlation  structure  among  the  t  responses  in  which  only  positive  correlation  is 
possible.  In  this  section,  we  investigate  a  more  general  model  that  permits  negative 
correlations  to  exist  between  pairs  of  responses.  We  first  review  an  analogous  model 
for  multivariate  count  data,  which  was  proposed  by  Aitchison  and  Ho  (1989),  and 
then  extend  their  ideas  to  the  binary  setting. 

Aitchison  and  Ho  (1989)  induced  correlations  between  multivariate  Poisson  counts 
X  =  (Xi, . . . ,  Xt)  by  assuming  that  (1)  these  counts,  given  a  vector  6  =  (0i, . . .  ,0t) 
are  independent  Poisson  variates  with  parameters  0  and  (2)  that  this  mean  vector 
0  has  a  log-normal(/i,  E)  distribution.  That  is,  log(0)  =  (log(#i), . . .  ,log(0t))  ~ 
MVN(fx,  £).  Note  that  the  Poisson  log-normal  distribution  discussed  in  the  last 
section  for  allowing  overdispersion  in  the  mutual  independence  model  is  a  special 
case  of  this  multivariate  model.  The  authors  chose  an  appropriate  transformation, 
exp,  of  a  multivariate  normal  random  vector  that  produces  a  random  variable  with 
support  appropriate  for  a  Poisson  mean  vector,  namely  the  positive  orthant,  R?+,  of 
^-dimensional  real  space.  Thus,  the  mixture  distribution  satisfies  the  restriction  that 
the  mean  vector  has  support  R+,  while  retaining  the  rich  covariance  structure  of  the 
multivariate  normal  mixture. 
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This  Poisson-log  normal  assumption  yields  closed-form  expressions  for  the 
marginal  moments  of  the  elements  of  X  since  the  log-normal  distribution  has  closed- 
form  expressions  for  its  moments: 

E(Xt)  =  E(E(Xi\9i))  =  Eft)  =  exp(W  +  (l/2)<r«). 

varTO  =  E{Xt)  +  {E(Xt))2  [exp(<7«)  -  1] 

corr(x.  Xa exP(g'j)  ~  ] 

1    "    ])  "  {[exp(a«)  -  1  +  (^TO)-1]  [exp(^)  -  1  +  (JB(A»)-i]}' 

where  try  denotes  the  (i,j)  element  of  E.  Examination  of  the  corr(Xj,.Xj)  reveals 
that  the  direction  of  this  correlation  is  determined  by  the  sign  of  oy  from  the  log- 
normal  distribution.  This  is  important  since  one  can  examine  the  maximum  likelihood 
estimate  £  and  know  if  the  count  correlations  are  estimated  to  be  positive  or  negative. 
The  authors  also  note  that 

\cxm{XhXj)\<\cott{0uei)\, 

so  that  the  count  correlation  range  is  bounded  above  by  the  correlation  between  the 
correponding  log  normal  means. 

Aitchison  and  Ho  (1989)  demonstrated  this  model's  utility  when  negative  cor- 
relations exist  between  clustered  counts.  They  analyzed  data  consisting  of  counts 
from  three  air  samplers  at  50  locations.  Aitchison  and  Ho  recognized  that  differ- 
ences among  the  50  locations  will  induce  correlations  between  the  three  counts  from 
a  particular  location.  The  most  common  way  of  inducing  correlations  between  the 
three  sampler  readings  for  a  given  location  is  to  include  a  location  random-effect  in 
the  model.  This  approach  induces  positive  correlations  between  the  three  samplers 
for  a  given  location.  The  Poisson-log  normal  analysis,  however,  provided  negative 
correlation  estimates  in  the  ML  estimate  S,  indicating  that  the  three  samplers  are 
competing  against  each  other  at  a  particular  location. 
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An  analogous  approach  could  be  used  to  account  for  negative  correlations  in  a 
2-variate  binomial  vector.  That  is,  let  Y  =  (Yx , . . . ,  Yt)  be  a  binomial  random  vector 
with  number  of  trials  (ni,...,nt)  and  success  probabilities  it  =  (*i, .  ..,ir«).  We 
choose  the  logistic  transformation  to  map  a  t-variate  multivariate  normal  vector  onto 
the  necessary  parameter  space  [0, 1]'  for  n.  Thus,  we  assume  that  the  binary  vector 
results  from  the  mixing  of  independent  Binomial(nj,7T;)  distributions  with  mixture 
distribution  specified  by 

exp(W-)         _ 
^-l+exp^)^-1'---'*'  (4"12j 

where  W  =  (Wi,...,Wt)  ~  iV(/i,£).  We  denote  this  multivariate  logistic-normal 
distribution  as  7r  ~  LAr*(/x,E),  and  the  resulting  multivariate  logit-normal  mixture 
distribution  for  Y  as  Y  ~  BLN1^  £). 

Unfortunately,  unlike  the  Poisson  log-normal  mixture,  the  multivariate  logit-normal 
distribution  does  not  have  closed-form  expressions  for  its  moments,  since  closed-form 
expressions  do  not  exist  for  the  moments  of  the  logistic-normal  distribution  and 

E(Yi)  =  E(E(Yt\ni))  =  niE(ni), 

var^)    =    E(var(yi|7ri))  +  var(E(yi|7ri)) 
=    ni£,(7ri(l  -  7Ti))  +  nt2var(7Ti) 
=    n<J5?0r,-)(l  -  rnE(in))  +  n^m  -  l)Etf), 

and 

cov(Y)    =    cov(£(Y|tt))  +  £(cov(Y|tt)) 

=    nt2cov(7r)  +  E(Diag[ni7ri(l  -  7Tj)]) 

Taylor  series  expansions  provide  approximations  for  the  logistic-normal  means, 
variances,  and  covariances  when  a  is  small.  Williams  (1982)  showed  that  for  small 
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cr,j,  the  mean  of  a  logistic-normal  random  variable  can  be  reasonably  approximated 

by 

E{7ri)  M     *M^) 
v  "       1  +  exp(^) 

Denote  this  approximate  value  as  p\.  Then  an  approximation  for  the  logistic-normal 
variance  is 

Var(7ri)  «  au  [p*  (1  -  p*)]2  • 

Also,  for  two  logistic-normal  random  variables  (7T,-,7r,),  we  have 

Cov(7Ti,7ri)  »  0{j  {(JiiOjj)1  p*  (1  -  p*)  p*  (l  -  p*)  ■ 

Our  simulation  work  shows  that  these  approximations  tend  to  break  down  when 
on  >  .64.  Thus,  we  simulated  variates  from  a 


BLN>        £ 


a2     a2p 
a2p     a2 


distribution  for  a  variety  of  (//,  cr,  p)  values  in  order  to  get  an  idea  of  the  prop- 
erties of  the  multivariate  logit-normal  distribution  for  a  wide  range  of  parameter 
values.  We  ran  100,000  simulations  at  all  combinations  of  \i  =  (—1.0,-0.5,0.0), 
a  =  (0.5, 1.0, 1.5,...,  5.5),  and  p  =  (-0.9, -0.8, ..  .,0.8,0.9).  We  only  consider 
negative  p  values  since  the  binary  means  are  symmetric  around  .5  for  positive  p. 
Since  this  produces  627  possible  (p,a,p)  combinations,  we  report  only  those  for 
p=  (-1.0,  -0.5, 0.0),  er  =  (0.5, 2.5, 5.5)  and  p=  (-.9, -.5,0,  .5,  .9).  Table  4.3  reports 
the  correlations  between  Y\  and  Yi  for  these  combinations,  while  Figure  4.5  plots  the 
binary  correlations  (solid  line)  and  logistic-normal  correlations  (dashed  line)  for  the 
full  range  of  p  values  for  several  (//,  o)  values. 

These  results  show  that  the  multivariate  logit-normal  distribution  has  properties 
that  are  similar  to  the  Poisson  log-normal  distribution.  We  see  that  the  binary  cor- 
relation has  the  same  sign  as  the  correlation  between  the  bivariate  normal  random 
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Table  4.3.  Simulated  Correlation  between  Yx  and  Y2  when  Y  =  (Yi,Y2)  is  Distributed 
as  BLN2(/i,  £),  when  n  =  -1.0,  -0.5, 0.0  and  a2  =  0.5, 2.5, 5.5 

P 

-0.5       0.0       0.5      0.9 


M 

a2 

-0.9 

1.0 

0.5 

-.074 

2.5 

-.241 

5.5 

-.354 

-.040  .002  .045  .075 
-.139  -.005  .142  .265 
-.193     -.001     .206     .388 


-0.5    0.5  -.089  -.046  .003  .042  .085 

2.5  -.268  -.146  .002  .152  .267 

5.5  -.387  -.204  -.003  .210  .397 

0.0     0.5  -.091  -.044  .001  .050  .089 

2.5  -.277  -.148  -.003  .152  .277 

5.5  -.401  -.218  -.001  .208  .400 


variables.  The  range  of  the  possible  binary  correlation  is  not  as  wide  as  that  of  the 
corresponding  logistic-normal  distribution. 

This  correlation  restriction  means  that  this  model  will  not  yield  a  good  fit  when 
the  data  exhibit  high  binomial  correlations.  Thus,  it  is  possible  to  see  a  poor  model 
fit  to  the  data  even  if  the  model  contains  as  many  parameters  as  there  are  cells. 
For  example,  consider  the  model  applied  to  the  complete  hepatitis  data  of  Table  3.6. 
If  we  estimate  an  unrestricted  mean  vector  /x  and  variance-covariance  matrix  E, 
we  are  fitting  an  eight-cell  table  with  a  model  containing  nine  parameters.  The 
model  fit,  however,  yields  G2  =  10.5.  Thus,  this  model  cannot  account  for  the 
high  binary  correlations  between  the  three  samples.  An  analogous  situation  is  the 
performance  of  the  logistic-normal  model  in  the  matched-pairs  setting  (i.e.  t  =  2). 
The  2x2  table  has  three  unrestricted  cell  probabilities  while  the  model  contains  three 
parameters:  (a,  A?/^)-  If  an  observed  table  exhibits  a  negative  correlation  between 
the  two  samples  (e.g.  odds  ratio  less  than  1.0),  the  logistic-normal  model  will  not 
be  able  to  reproduce  the  observed  table  since  the  random  subject  effects  impose  a 
positive  correlation  structure.  Consider  the  example 
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Figure  4.5.  Corr(Yi,y2)  (Solid  Line)  and  Corr(7Ti,  7^)  (Dotted  Line)  as  a  Function  of 
p,  for  /x=  (-1.0,0.5,0.0)  and  a  =  (0.5,2.5,5.5) 
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The  odds  ratio  is  .16,  and  the  likelihood  ratio  test  for  the  logistic-normal  model  is 
G2  =  3.6.  The  fit  of  this  model  is  on  the  boundary,  with  a  =  0.0.  Likewise,  the 
BLN3  fit  for  the  hepatitis  data  is  also  on  the  boundary  with  all  estimated  correlations 
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in  £  equal  to  one.  Thus,  like  the  Poisson  log-normal  model,  the  multivariate  logit- 
normal  model  allows  negative  correlations,  but  still  has  limitations  with  respect  to 
the  patterns  of  correlations  that  the  model  is  able  to  fit. 

4.3.1     Estimation 

Let  g(n\fi,  E)  denote  the  probability  function  of  the  d-dimensional  component- 
wise logistic  transformation  of  a  t-variate  N(fx,  S)  distribution,  so  that 

<7(tt|/*,E)    =    (2tt)-*/2  l^r1/2  |n  [tt^I  -  tt,)]}      x 

exp  j-i  (logit(Tr)  -  fx)'  ST1  (logit(Tr)  -  /i)}  , 

where  logit(7r)  is  taken  component-wise. 

Note  that  the  logistic-normal  vector  n  differs  from  the  vector  modelled  with  the 
additive  logistic-normal  distribution  in  order  to  analyze  compositional  data.  The  ad- 
ditive logistic-normal  distribution  (Aitchison  and  Shen  (1980)  and  Aitchison  (1986)) 
is  an  appropriate  distribution  for  random  vectors  on  the  simplex;  that  is,  n'  = 
(-k[  , . . . ,  n't)  with  the  constraints  0  <  7rJ  <  1 ,  j  =  l,...,t  and  X^'=i  n'j  —  !•  This 
distribution  is  induced  using  the  transformation 

1       l+exp(W1)-l-...  +  exp(W(t_1))'      J        '••'' 


7T, 


*      H-exp(W1)  +  ...  +  exp(W(t_1))' 

where  W  ~  A^/z,  £).  Rather  than  being  required  to  sum  to  one,  the  7r  vector 
of  means  for  the  multivariate  logit-normal  model  has  support  [0, 1]*,  so  that  the 
component-wise  transormation  (4.12)  is  more  appropriate  than  the  additive  form  for 
this  application. 
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The  BLN*(/l*,  E)  mixture  then  has  density  function 

d 
p(y|M,£)  =  J[oi]tY[f(yi\ni^M^^)d^  (4-13) 

where  f(yi\rii,ni)  denotes  the  usual  binomial  density  with  n*  trials  and  probability 

of  SUCCeSS  7Tj. 

Estimation  of  the  parameters  (/x,  E)  is  more  complex  computationally  for  this 
model  compared  to  the  other  mixed-models  we  have  examined  because  we  must  use 
multi-dimensional  Gaussian  quadrature  to  approximate  the  ^-dimensional  integral  in 
density  (4.13).  This  employs  the  same  strategy  of  writing  the  density  as 


/    /i(z)exp(— -z'z)dz 


and  now  approximating  it  by  a  ^-dimensional  weighted  average  of  the  function  h 
evaluated  at  the  q*  different  quadrature  vectors,  zkl___kt  =  (zkl,. . .  ,£&),  where  {zkm}, 
km  =  l,...,q,  m  =  1,...,£  are  the  univariate  Gaussian  quadrature  nodes  of  Sec- 
tion 3.1.2.  The  multivariate  quadrature  weights  vki   k  are  products  of  the  univariate 

quadrature  weights, 

t 


The  transformation 

logit(7r)  -  n  =  Qz, 

where  Qtxt  is  the  unique  lower  triangular  matrix  with  positive  diagonal  elements  such 
that  S  =  QQ'  is  positive-definite,  yields  the  necessary  form 

P(y|/*,Q)  =  (27r)-t/2^/l(y,M,Q,z)exp|-^z,z}dz 


with 


(' 


h(y,  /x,  Q,  z)  =  exp  <  y'(/x  +  Qz)  -  ltlog  [1  +  exp(/i  +  Qz)]  +  log 


n 

y 
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ML  estimates  ft  and  £  =  QQ'  are  obtained  by  maximizing  the  approximation 

P(y  lM»  Q)  =  £  %>  ^'  Q'  Zk)exp  |--zk'zk  J  i£,  (4.14) 

where  k  =  (&i, . . . ,  fct). 

We  use  FSQP  to  maximize  (4.14)  with  respect  to  (/z,  Q).  We  were  concerned 
about  the  performance  of  this  maximization  algorithm  when  handling  such  a  complex 
function,  so  we  programmed  Aitchison  and  Ho's  (1989)  analogous  Poisson  log-normal 
density  in  FSQP  and  computed  the  ML  estimates  for  the  four  models  fit  to  the  sampler 
data  discussed  in  the  previous  section.  The  results  for  all  four  models  matched  those 
reported  in  Aitchison  and  Ho's  (1989)  Table  5,  demonstrating  that  FSQP  sucessfully 
maximimized  the  Poisson  analogue  of  (4.14). 

The  generality  of  the  multivariate  logit-normal  model  allows  us  to  test  various 
hypotheses  concerning  the  t  responses.  For  instance,  if  we  fit  the  model  with  the  con- 
straint that  the  off-diagonal  elements  in  £  are  zero,  this  maximum  log-likelihood  can 
be  compared  to  the  log-likelihood  with  unrestricted  Oij  to  test  mutual  independence 
between  the  t  responses.  Alternatively,  we  could  test  the  equivalence  of  the  t  means 
or  that  no  differences  exist  between  the  t  responses: 

fij  =  /i,  (Tjj  -  a2, 0^  =  pa2. 

Aitchison  and  Ho  (1989)  term  this  hypothesis  the  isotrophic  hypothesis.  The  logistic- 
normal  model  of  Section  3.1.2  is  the  special  case 

with  p  =  1  (Agresti  1997). 

The  multivariate  logit-normal  model  becomes  computationally  difficult  to  fit  when 
/  is  moderate  to  large.  Using  FSQP,  maximizing  a  10-point  quadrature  approximation 
of  the  log-likelihood  when  t  =  3  takes  approximately  1-2  hours  on  a  SUN  SPARCsta- 
tion  20  with  48  MB  of  RAM.  Increasing  the  dimension  to  four  substantially  increases 
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Table  4.4.  Observed  Frequencies  and  Fitted  Counts  of  infection  profiles  for  influenza 
data 


•*t"l,...,*4 

Fitted  Values 

(ii,..., i4) 

LN  (q  =  10) 

H02 

BLN4  [q  =  10) 

Cnst.  BLN4 

0000 

140 

138.4 

138.2 

138.7 

137.8 

000  1 

31 

20.8 

20.8 

31.0 

31.3 

00  10 

16 

19.5 

19.6 

17.6 

18.0 

00  11 

3 

4.1 

4.1 

2.8 

2.6 

0100 

17 

22.1 

22.2 

17.8 

18.6 

010  1 

2 

4.6 

4.6 

2.6 

2.4 

0110 

5 

4.3 

4.3 

4.1 

3.8 

0  111 

1 

1.3 

1.2 

0.5 

0.4 

1000 

20 

26.2 

26.3 

22.0 

21.8 

100  1 

2 

5.5 

5.5 

1.7 

1.8 

10  10 

9 

5.1 

5.1 

6.9 

7.1 

10  11 

0 

1.5 

1.5 

0.4 

0.4 

1100 

12 

5.8 

5.8 

10.6 

10.8 

110  1 

1 

1.7 

1.7 

0.6 

0.5 

1110 

4 

1.6 

1.6 

5.4 

5.4 

1111 

0 

0.6 

0.6 

0.2 

0.1 

Deviance  (df) 

27.7  (10) 

27.7  (10) 

3.9  (1) 

4.3  (5) 

fitting  time  to  approximately  one  day,  since  we  have  increased  the  size  of  the  grid 
of  quadrature  points  from  103  to  104.  A  four-dimensional  constrained  fit  (e.g.  equal 
means  or  equal  correlations)  takes  approximately  1.5  to  2  days. 

4.3.2    Influenza  Example 

We  now  use  the  multivariate  logit-normal  model  to  analyze  a  data  set  first  consid- 
ered by  Haber  (1986)  and  later  reanalyzed  by  Darroch  and  McCloud  (1990).  The  data 
are  frequencies  of  infection  profiles  of  a  sample  of  263  individuals  for  four  influenza 
outbreaks  occuring  in  the  winters  1977/1978  to  1980/1981  in  Tecumseh,  Michigan. 
The  data  are  reported  in  Table  4.4. 

The  first  and  fourth  outbreaks  are  known  to  have  been  caused  by  the  same  virus 
type,  while  the  viruses  in  the  second  and  third  outbreaks  were  of  different  types.  Be- 
cause the  first  and  fourth  outbreaks  were  caused  by  the  same  virus  type,  a  subject's 
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response  for  these  two  outbreaks  is  negatively  correlated.  This  is  because  contracting 
influenza  during  the  first  outbreak  provides  a  stronger  immunity  against  a  subse- 
quent outbreak  of  that  type,  and  thus  lowering  the  probability  of  infection  during  the 
fourth  outbreak.  Darroch  and  McCloud  (1990)  separately  measured  the  two  sources  of 
dependence,  population  heterogeneity  and  negative  within-subject  (1,4)  correlation, 
among  the  four  responses  by  using  the  fact  that  there  exists  one  pair  of  responses 
that  produce  negative  within-subject  dependence. 

Before  we  apply  the  multivariate  logit-normal  model  to  this  example,  we  first  fit 
the  logistic-normal  model  of  Section  3.1.2  to  demonstrate  the  inadequacy  of  this  type 
of  random-effect  model  when  negative  correlations  exist.  This  fit  yields  G2  =  27.7  on 
df  =  10  (p  =  .002).  Not  unexpectedly,  this  model  fits  the  data  poorly,  since  it  forces 
all  pairwise  correlations  to  be  non-negative.  Indeed,  the  observed  (1,4)  marginal  odds 
ratio  is  0.32,  while  the  fitted  value  is  1.44.  The  model  fit  is  reported  in  Table  4.4. 

The  multivariate  logit-normal  model  yields  ML  estimates 


M 


/ 


V 


2.35  \ 

"    3.77 

3.65 
2.93 

,    s  = 

4.39 

2.41 

10.38 
2.63 

4.58 

3.45  ) 

.  -2.82 

-2.19 

-1.31    8.18 

This  estimate  of  the  variance-covariance  matrix  corresponds  to  correlation  matrix 
estimate 

1.00 

0.70  1.00 

0.58  0.38       1.00 

_  -0.51  -0.23    -0.21    1.00 

This  model  fit  yields  G2  =  3.9  based  on  df  =  1.  Thus,  we  see  some  evidence  of  lack  of 
fit  since  only  have  one  residual  degree  of  freedom.  This  model  fit  has  the  advantage 
of  demonstrating  in  what  respect  the  logistic-normal  model  fits  poorly.  The  model 
estimates  that  all  pairwise  correlations  between  outbreak  four  and  the  other  three 
outbreaks  are  negative,  while  the  correlation  structure  of  the  first  three  outbreaks 
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contains  positive  pairwise  correlations.  In  fact,  if  we  fit  the  logistic-normal  model 
to  the  23  table  cross-classifying  outbreaks  (1,2,3),  we  see  that  the  model  fits  this 
table  well  with  G2  =  3.7  based  on  3  df  (p  =  .30).  We  can  also  fit  the  multivariate 
logit-model  while  constraining  the  correlation  matrix  to  be  of  form 


1.00 

pi  1.00 

Pi  Pi      1-00 

.     P2  P2  P2         1-00 


Table  4.4  shows  the  model  fit  under  the  label  "Cnst.  BLN4".  We  see  that  this 
simpler  model  fits  the  data  well  and  we  gain  4  degrees  of  freedom  by  constraining  the 
correlations  to  be  one  of  only  two  values.  This  model  yields  goodness  of  fit  G2  =  4.3 
based  on  df=5.  Thus,  we  see  no  evidence  of  lack  of  fit.  Thus,  we  conclude  that  the 
poor  fit  of  the  logistic-normal  model  results  from  the  negative  correlations  caused  by 
the  inclusion  of  the  fourth  outbreak  without  any  prior  knowledge  of  the  virus  types. 

4.3.3    Application  to  Capture-Recapture 

We  now  apply  the  multivariate  logit-normal  model  to  capture-recapture.  We 
again  use  Sanathanan's  conditional  (on  n)  approach  by  maximizing  the  conditional 
log-likelihood  with  respect  to  (fjt,  Q).  Since  employing  Gaussian  quadrature  over  four 
dimensions  is  computationally  intensive,  we  fit  this  model  to  the  t  =  3  "sample"  data 
set  obtained  by  collapsing  the  influenza  data  set  (N  =  263)  of  Table  4.4  over  the 
third  outbreak  and  pretending  that  cell  (0, 0, 0)  is  unknown. 

Using  10-point  quadrature,  the  population  size  estimate  is  Nc  =  306.0.  This 
estimate,  however,  is  approximately  the  same  absolute  distance  from  N  as  is  the 
logistic-normal  estimate  of  TV*  =  228.9,  even  though  the  logistic-normal  model  does 
not  fit  the  observed  table  well  with  G2  =  18.2  based  on  df  —  3.  The  logistic-normal 
interval  produces  a  characteristically  wide  profile-likelihood  interval  of  (174.4, 1243.9), 
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while  the  homogeneous  two-factor  interaction  model  yields  N  —  173.3  and  (109.5, 
695.8).  This  again  reflects  the  nonstandard  nature  of  this  extrapolation  problem  in 
that  models  that  do  not  fit  the  complete  table  well,  or  even  the  observed  table  well, 
can  produce  intervals  that  contain  the  true  population  size. 

It  remains  to  be  seen  if  the  multivariate  logit-normal  model  can  improve  on  these 
two  models  that  do  not  fit  well  by  producing  a  narrower  confidence  interval.  As  for 
the  overdispersed  model  of  the  last  section,  we  inspected  the  deviance  over  a  range  of 
N  values  for  q  =  10.  Unfortunately,  this  profile  was  highly  irregular  with  several  large 
jumps  between  consecutive  iV-values.  The  results  of  Section  4.2.3  suggest  that  more 
quadrature  points  are  needed  to  produce  a  smooth  deviance  profile.  This,  however, 
is  computationally  infeasible  at  this  time  since  even  for  the  10-point  quadrature  we 
were  forced  to  run  a  profile  across  500  N- values  as  five  separate  profiles  across  100 
iV-values  run  simultaneously  on  5  different  Sun  Sparc  Station  10's  since  each  of  these 
separate  profiles  took  about  two  days  to  run. 

4.4     Conclusions 

In  this  chapter  we  investigated  serial  dependence  approaches  to  modelling  capture- 
recapture  data,  which  led  to  an  alternative  motivation  for  the  log-linear  model  of 
homogeneous  two-factor  interaction.  We  applied  an  overdispersed  Poisson  model  to 
capture-recapture,  and  we  also  introduced  an  alternative  mixed  model  that  induces 
dependence  between  t  reponses  by  postulating  the  vector  of  binary  means  as  being 
distributed  according  to  a  i-variate  logistic-normal  distribution  with  general  covari- 
ance  matrix  S. 

The  serial  dependence  models  of  Section  4.1  postulate  the  dependencies  between 
the  t  responses  as  being  generated  within  subjects,  rather  than  between  subjects.  By 
examining  the  column  of  covariates  associated  with  the  serial  dependence  parameter 
7,  we  see  that  when  most  subjects  are  captured  on  only  a  few  occasions,  this  log-linear 
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model  produces  much  smaller  TV-estimates  than  the  H02  model,  with  confidence  in- 
tervals at  least  as  wide  as  the  narrow  independence  model  because  of  the  addition  of 
one  extra  parameter  into  the  model.  Simulations  in  Chapter  5  show  that,  when  the 
data  are  generated  from  the  logistic-normal  model,  these  wider  confidence  intervals 
from  model  (4.4)  produce  better  coverage  than  that  produced  by  the  the  mutual  inde- 
pendence intervals.  Chapter  5  also  indicates  that  the  addition  of  this  extra  parameter 
to  the  H02  model  can  improve  upon  the  H02  coverage  when  the  sample  size  is  small 
and  the  probability  of  capture  is  moderate  (i.e.  the  occasion  parameters  /3  are  close 
to  zero).  We  also  extend  the  serial  dependence  assumption  to  situations  in  which 
the  sampling  occasions  are  unordered  in  time.  This  extension  leads  to  an  alternative 
interpretation  of  the  log-linear  model  of  homogeneous  two-factor  interaction. 

The  overdispersed  Poisson  model  of  Section  4.2  shows  promise  in  capture-  recap- 
ture applications.  The  model  adjusts  the  narrow  confidence  interval  produced  by  the 
mutual  independence  model  by  adding  an  overdispersion  term,  oZ\,  to  the  simpler 
model.  We  feel  that  this  mixed  model  is  preferable  to  the  logistic-normal  model  when 
most  subjects  are  captured  on  only  a  few  sampling  occasions  since  this  is  precisely 
when  the  logistic-normal  model  yields  extremely  flat  log-likelihoods  that  provide  little 
to  no  information  on  the  population  size. 

The  multivariate  logit-normal  model  is  more  general  than  the  logistic-normal 
model  in  that  negative  correlations  among  the  t  responses  are  possible.  We  dis- 
cuss properties  of  the  model  and  attempt  to  describe  the  meaning  of  the  multivariate 
normal  parameters  (//,  E)  on  the  binomial  scale.  We  show  that  this  model  has  ap- 
plication in  complete  tables  with  negative  correlations  for  which  a  traditional  mixed 
model  fits  poorly.  This  model  can  indicate  the  reason  behind  a  poor  fit  without  any 
prior  knowledge  on  the  t  responses.  For  capture-recapture  studies,  one  can  obtain 
point  estimates  for  N  with  this  model.  At  this  time,  however,  it  is  computationally 
infeasible  to  obtain  a  profile  likelihood  or  bootstrap  confidence  interval  for  N  with 
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the  multi-dimensional  Gaussian  quadrature  approximation  we  discuss  here.  A  pos- 
sible alternative  approximation  is  Monte  Carlo  integration  as  discussed  by  Fahrmeir 
and  Tutz  (1994).  Much  research  remains  to  be  done  exploring  the  implications  and 
potential  applications  of  such  a  new  model. 

In  short,  of  the  methods  discussed  in  this  chapter,  we  feel  the  H02SE  and  overdis- 
persed  Poisson  models  find  application  in  capture-recapture  studies.  The  computa- 
tional ease  of  the  log-linear  model  and  the  improvement  of  the  Poisson  model  over  the 
logistic-normal  model  make  them  worthy  of  consideration  when  estimating  population 
size. 


CHAPTER  5 
SIMULATION  STUDIES 


We  now  present  results  of  simulation  studies  that  examined  the  performances  of 
the  point  estimators  and  interval  estimators  for  N.  The  point  estimators  were  judged 
in  terms  of  absolute  error,  while  the  confidence  intervals  were  compared  in  terms  of 
coverage  probabilities  and  width. 

Section  5.1  investigates  the  performance  of  the  bootstrap  intervals  of  Section  2.3.2 
used  in  conjunction  with  the  models  of  Chapter  3.  In  this  study,  we  restrict  ourselves 
to  the  assumption  that  the  logistic-normal  model  is  the  underlying  model  since  (1)  the 
bootstrap  is  computationally  intensive  even  for  a  rough  interval  formed  by  B  =  200 
since  we  must  use  the  iterative  FSQP  algorithm  for  each  resampled  table,  and  (2) 
the  primary  purpose  of  this  section  is  to  demonstrate  the  dangers  of  using  the  boot- 
strap with  the  latent  class  model.  Section  5.2  investigates  an  alternative  bootstrap 

associated  with  the  conditional  estimate  Nc- 

Section  5.3  compares  the  profile  likelihood  intervals  based  on  the  models  presented 
in  Chapters  3  and  4.  The  relative  ease  with  which  we  can  compute  95%  profile 
likelihood  intervals  allows  us  to  investigate  the  performances  of  the  different  point 
and  interval  estimates  for  several  different  underlying  models  and  parameter  settings. 
Specifically,  we  simulated  point  and  interval  estimates  based  on  the  models  from 
the  previous  two  chapters  for  a  t  =  4  sample  experiment  as  (1)  a  and  /3  vary  in 
logistic-normal  model  (3.6),  (2)  cr,  (3,  and  (^1,^2)  vary  in  quasi-symmetric  latent 
class  model  (3.20),  (3)  A  and  (3  vary  in  log-linear  model  of  homogeneous  two-factor 
interaction  model  (3.5),  and  (4)  o,  (3,  and  7  vary  in  serial  dependence  model  (4.1). 
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We  describe  the  design  of  the  profile  likelihood  studies  in  further  detail  in  Section  5.3. 
We  discuss  the  trade  off  between  narrow  confidence  intervals  for  N  versus  attained 
nominal  confidence  in  Section  5.4  and  present  recommendations  in  Section  5.5. 

5.1     Numerical  Optimization  and  the  Bootstrap 

We  first  present  results  of  a  simulation  study  that  examined  properties  of  the  point 
and  interval  estimators  based  on  the  models  discussed  in  Chapter  3,  when  the  true 
model  is  the  logistic-normal  model  with  various  values  for  (N,a,(3).  For  three  log- 
linear  models  (homogeneous  2-factor  interaction,  heterogeneous  2-factor  interaction, 
and  mutual  independence),  the  latent  class  model,  and  the  logistic-normal  model 
(q  =  10),  we  studied  the  absolute  error  N  -  N  ,  the  median  width  of  the  resulting 
bootstrap  confidence  intervals,  and  actual  coverage  probabilities  for  these  intervals. 
We  use  median  width  since  very  wide  confidence  intervals  resulting  from  just  a  few 
particularly  unstable  tables  can  have  undue  influence  on  the  mean  width.  We  chose 
to  use  10  quadrature  points  for  computational  ease.  Figure  3.1  suggests  that  this 
log-likelihood  approximation  should  be  adequate  for  a  <  1.5. 

We  first  considered  the  performance  of  the  percentile  bootstrap  intervals  based 
on  the  numerical  optimization  of  L  with  respect  to  N.  For  each  combination  of 
TV  =  (80,320)  and  a  -  (0.0,0.5, 1.0),  we  generated  1000  24  tables  of  capture-history 
counts  from  the  logistic-normal  model  with  (3  —  0.  Recall  that  {/?,■}  reflects  the 
sampling  effort  at  sample  j.  Thus,  a  large  negative  fy  reflects  small  probability  of 
capture  at  occasion  j,  while  a  large  positive  fy  reflects  a  large  probability  of  capture  at 
occasion  j.  The  above  settings  provide  stable  data  sets  for  which  the  profile  likelihoods 
for  the  logistic-normal  model  are  usually  well-behaved  (See  Section  3.5).  When  a  —  0, 
the  model  is,  equivalently,  the  mutual  independence  log-linear  model.  The  90%, 
95%,  and  99%  ordinary  percentile  bootstrap  intervals  of  Section  2.3.2  were  computed 
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based  on  B  =  200  resamples  for  each  24  table  using  each  model,  and  the  percentage 
of  these  intervals  that  contained  N  was  used  to  estimate  the  true  coverage  of  the 
confidence  intervals.  The  simulated  coverage  results  should  not  be  strictly  compared 
to  the  nominal  coverage,  since  the  percentile  bootstrap  is  not  the  preferred  bootstrap 
confidence  interval.  (We  would  prefer  to  use  the  BCa  method,  but  the  time  needed  to 
compute  the  necessary  percentile  corrections  on  top  of  obtaining  B  =  200  resamples 
for  each  of  the  1000  data  sets  for  each  (N,  a)  proved  prohibitive.)  The  value  of  B  has 
little  effect  on  coverage  properties,  but  it  does  affect  variability  in  width  (Hall,  1986). 
B  =  200  was  selected  for  computational  feasibility  and  consistency  with  existing 
capture-recapture  studies  (Chao  and  Tsay  (1996a,  1996b)).  Rather,  we  compare  the 
simulated  coverages  for  the  different  models  to  get  a  rough  idea  of  how  these  models 
perform  relative  to  one  another  when  heterogeneity  is  present.  The  standard  error  of 
the  coverage  estimates  for  the  95%  intervals  (when  they  are  approximately  unbiased) 

*s  v^    iooo    )  =  -007,  while  the  standard  errors  for  the  other  intervals  are  computed 

similarly.  An  upper  bound  for  these  standard  errors  is  J (jqqo)  =  -016 

We  first  make  comparison  based  on  using  the  parametric  bootstrap  to  construct 
intervals.  Table  5.1  presents  the  results.  Even  though  it  is  more  general,  the  log- 
linear  model  of  heterogeneous  2-factor  interaction  (HE2)  did  not  perform  as  well 
as  the  homogeneous  2-factor  interaction  model.  The  actual  coverages  of  the  confi- 
dence intervals  for  the  HE2  model  were  usually  lower  than  those  of  H02,  yet  the 

intervals  were  wider  since  the  model  has  I        J  —  1  more  parameters  than  does  the 

simpler  model.  Thus,  Table  5.1  reports  only  the  performances  of  the  logistic-normal 
model  (q  =  10),  homogeneous  2-factor  interaction  model,  quasi-symmetric  latent 
class  model,  and  mutual  independence  model.  When  the  probability  of  capture  at 
each  sample  is  moderate  (i.e.  0  =  0),  the  latent  class  model  has  coverage  similar 
to  the  logistic  normal  model  for  small  to  moderate  heterogeneity  (a  —  0.0,0.5),  but 
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this  coverage  decreases  seriously  as  the  heterogeneity  becomes  large.  The  H02  model 
has  lower  coverage  than  the  logistic  normal  model,  but  is  stable  as  o  increases.  The 
interval  widths  are  similar  for  the  two  models,  as  are  the  average  absolute  errors  of 
point  estimates  in  Table  5.2. 

Table  5.1.  Estimated  coverage  and  median  width  of  parametric  percentile  boot- 
strap intervals  for  N  from  the  logistic-normal  (q  —  10)  model,  the  homogeneous 
2-factor  interaction  model,  the  quasi-symmetric  latent  class  model,  and  the  mutual- 
independence  model  when  t  =  4  sample  capture-recapture  data  are  generated  from 

the  logistic-normal  model  with  /3  =  0 

Nominal  Estimated  Coverage  Median  Width 


N      a 

Coverage 

LN 

H02 

QLC 

IND. 

LN 

H02 

QLC 

IND 

80      0 

90 

.930 

.734 

.930 

.821 

12.2 

10.4 

11.8 

8.4 

95 

.978 

.808 

.976 

.864 

15.9 

13.1 

15.8 

10.0 

99 

.992 

.895 

.995 

.919 

23.3 

19.1 

28.4 

13.7 

.5 

90 

.864 

.759 

.846 

.498 

14.3 

13.7 

12.1 

7.7 

95 

.920 

.830 

.918 

.562 

18.1 

17.5 

16.3 

9.3 

99 

.990 

.895 

.987 

.678 

26.7 

25.0 

28.7 

12.5 

1 

90 

.786 

.769 

.659 

.060 

22.9 

21.4 

15.3 

6.1 

95 

.862 

.836 

.767 

.083 

30.0 

26.7 

20.6 

7.2 

99 

.938 

.910 

.920 

.116 

57.6 

38.4 

35.9 

9.9 

320     0 

90 

.942 

.831 

.955 

.873 

23.5 

24.9 

25.1 

17.6 

95 

.978 

.897 

.984 

.941 

28.8 

29.9 

33.5 

21.0 

99 

1.00 

.952 

.997 

.972 

39.9 

40.1 

56.3 

27.9 

.5 

90 

.880 

.860 

.898 

.285 

30.0 

31.4 

31.5 

15.9 

95 

.930 

.916 

.960 

.369 

36.3 

38.1 

41.3 

19.1 

99 

.972 

.959 

.995 

.502 

48.9 

50.8 

69.2 

25.2 

1 

90 

.854 

.871 

.710 

.000 

48.7 

47.1 

46.4 

12.7 

95 

.908 

.922 

.802 

.000 

59.2 

57.0 

59.9 

31.3 

99 

.972 

.969 

.915 

.001 

80.2 

75.4 

95.7 

20.1 

Besides  the  fact  that  the  latent  class  intervals  are  slightly  wider  than  the  logistic- 
normal  and  homogeneous  2-factor  interaction  intervals,  we  see  nothing  in  the  QLC 
results  to  indicate  that,  theoretically,  this  model  provides  little  information  on  the 
population  size  in  the  form  of  flat  log-likelihoods  (see  Section  3.5).  We  will  see  later 
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Table  5.2.  Estimated  mean  absolute  error,  N  -  N  ,  of  N  from  the  logistic-normal 
(q  =  10)  model,  the  homogeneous  2-factor  interaction  model,  the  quasi-symmetric 
latent  class  model,  and  the  mutual-independence  model  when  t  =  4  sample  capture- 
recapture  data  are  generated  from  the  logistic-normal  model  with  (3  =  0 

N      a         LN     H02    QLC    IND 


80 

0 

2.7 

3.2 

2.9 

2.1 

.5 

3.7 

4.3 

4.0 

3.6 

1 

6.4 

6.2 

13.1 

8.4 

320 

0 

5.5 

6.6 

5.5 

4.2 

.5 

8.0 

7.9 

10.9 

10.7 

1 

12.8 

12.2 

18.4 

31.3 

in  this  section  that  for  certain  parameter  settings,  this  can  lead  to  extremely  narrow 
intervals  that  yield  low  coverage. 

The  independence  model  clearly  underestimates  TV  in  the  presence  of  population 
heterogeneity.  The  confidence  intervals  are  much  narrower  than  the  corresponding 
ones  for  H02  and  the  logistic-normal  model,  yet  provide  misleading  inferences  when 
heterogeneity  exists  in  that  they  rarely  contain  N.  Even  when  the  true  underlying 
model  is  the  mutual  independence  model,  the  coverage  probabilities  are  well  below 
nominal  level.  Since  the  value  of  B  has  little  effect  on  coverage  properties  (Hall, 
1986),  this  is  an  indication  that  the  bootstrap  does  not  work  well  in  this  particular 
application  of  capture- recapture. 

These  simulations  compare  these  models  on  LN's  terms,  since  the  other  mod- 
els' confidence  intervals  are  obtained  by  incorrectly  bootstrapping  from  the  assumed 
model.  Accordingly,  we  next  examined  the  performance  of  the  same  models  using 
the  nonparametric  bootstrap.  Table  5.3  presents  the  results.  For  the  most  part  these 
intervals  are  slightly  wider  than  their  parametric  counterparts.  As  anticipated,  the 
H02  nonparametric  intervals  have  improved  coverage  relative  to  the  H02  parametric 
intervals,  so  that  the  difference  between  the  coverage  figures  for  H02  and  LN  are 
smaller  than  they  were  for  the  parametric  intervals. 
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Table  5.3.  Estimated  coverage  and  median  width  of  nonparametric  percentile  boot- 
strap intervals  for  N  from  the  logistic-normal  (q  =  10)  model,  the  homogeneous 
2-factor  interaction  model,  the  quasi-symmetric  latent  class  model,  and  the  mutual- 
independence  model  when  t  =  4  sample  capture-recapture  data  are  generated  from 

the  logistic-normal  model  with  j3  =  0 

Nominal  Estimated  Coverage  Median  Width 


N      a 

Coverage 

LN 

H02 

QLC 

IND 

LN 

H02 

QLC 

IND 

80      0 

90 

.896 

.829 

.910 

.854 

11.5 

11.6 

11.7 

8.1 

95 

.950 

.898 

.954 

.899 

14.5 

14.7 

15.3 

9.8 

99 

.981 

.953 

.978 

.939 

20.9 

21.0 

24.9 

13.3 

.5 

90 

.890 

.857 

.834 

.568 

15.2 

16.0 

12.6 

7.5 

95 

.931 

.902 

.912 

.643 

19.7 

20.2 

16.4 

9.1 

99 

.971 

.949 

.946 

.734 

29.4 

29.2 

30.9 

12.3 

1 

90 

.875 

.844 

.780 

090 

26.3 

24.3 

19.9 

5.8 

95 

.913 

.901 

.846 

.114 

34.5 

30.4 

27.9 

7.1 

99 

.965 

.951 

.944 

164 

61.6 

44.8 

50.5 

9.6 

320     0 

90 

.899 

.862 

.945 

.873 

22.3 

25.4 

22.6 

17.6 

95 

.959 

.920 

.984 

.941 

27.6 

30.6 

29.3 

21.0 

99 

.992 

.964 

.997 

.972 

38.0 

40.5 

48.6 

27.8 

.5 

90 

.888 

.888 

.890 

.328 

31.9 

32.7 

37.7 

16.1 

95 

.934 

.928 

.951 

.411 

38.6 

39.1 

51.1 

19.1 

99 

.977 

.967 

.985 

.553 

51.2 

52.6 

89.1 

25.2 

1 

90 

.875 

.889 

.771 

.000 

51.0 

48.8 

52.4 

12.7 

95 

.932 

.939 

.851 

.000 

61.8 

59.1 

69.0 

15.2 

99 

.979 

.976 

.927 

.001 

84.1 

79.0 

109.5 

20.1 

We  next  consider  a  situation  that  is  probably  more  typical  in  real  capture-  recap- 
ture experiments,  that  of  small  probabilities  of  capture.  We  generated  1000  23  tables 
from  the  logistic-normal  model  with  parameters  given  by  the  ML  fit  of  the  complete 
hepatitis  data,  namely  a  =  1.12  and  /3  =  —(1.38,1.54,1.48).  Table  5.4  presents  the 
results.  The  logistic-normal  model's  flat  log-likelihood  produces  point  estimates  that 
can  be  far  from  the  true  N,  but  with  very  wide  confidence  intervals.  In  this  situa- 
tion, the  H02  model  performs  better  than  the  logistic-normal  model,  even  though  the 
logistic-normal  model  generated  the  data.   Coverage  probabilities  are  similar  to  the 
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Table  5.4.  Estimated  mean  absolute  error  of  N  and  estimated  mean  width  and 
coverage  of  parametric  (P)  and  nonparametric  (NP)  percentile  bootstrap  intervals 

for  N  from  the  logistic-normal  (q  =  10)  model,  the  homogeneous  2-factor  interaction 
model,  and  the  latent  class  model  when  t  =  3  sample  capture-recapture  data  are 
generated  from  the  logistic-normal  model  with  parameters  N  =  545,  a  —  1.12  and 
(3  =  —(1.38, 1.54, 1.48)  as  obtained  from  the  complete  hepatitis  data. 

Nominal     Estimated     Median      Median 
Boot.     Model     Coverage      Coverage      Length     Abs.  Err. 


LN  90  .857  571.9 


H02 


LC 


NP         LN 


H02 


LC 


95 

.911 

902.8 

99 

.974 

1419.5 

90 

.867 

399.1 

95 

.924 

500.0 

99 

.974 

692.4 

90 

.007 

86.7 

95 

.014 

103.9 

99 

.061 

136.8 

90 

.884 

630.5 

95 

.942 

1005.7 

99 

.983 

1518.8 

90 

.892 

423.6 

95 

.941 

525.6 

99 

.981 

730.1 

90 

.039 

99.9 

95 

.070 

121.2 

99 

.158 

160.1 

107.8 


87.7 


152.0 
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logistic-normal  model,  while  the  absolute  error  of  the  point  estimates  is  much  smaller 
than  that  of  the  other  models,  and  the  width  of  the  confidence  intervals  is  about  half 
that  of  the  logistic-normal  model. 

This  study  shows  the  optimistically  narrow  confidence  intervals  produced  by  the 
latent  class  model.  In  this  case,  this  numerical  optimization  approach  can  provide  no 
warning  that  the  model  provides  little  information  on  the  population  size,  and  using 
the  resulting  confidence  interval  is  clearly  misleading  since  for  t  —  3,  the  true  interval 
is  {tilower,  oo),  for  some  ulower  >  n  (see  Section  3.5).  Because  of  this  phenomenon, 
one  must  search  across  the  likelihood  surface,  either  in  the  form  of  G2(no...o)  or  Ljv  to 
identify  this  flat  surface.  When  we  examine  the  performance  of  Nc,  we  introduce  an 
alternative  bootstrap  that  is  more  likely  to  reflect  the  flat  log-likelihood  associated 
with  the  latent  class  model. 

Another  disadvantage  of  the  bootstrap  based  on  the  numerical  optimization  is 
that  it  is  possible  to  obtain  a  lower  endpoint  for  N  that  is  less  than  n.  This  occurs 
when  N  is  close  to  n,  so  that  when  we  resample  from  Mult  (TV,  n),  it  is  possible  to 

obtain  n*  «  n.  Since  A\*  must  only  satisfy  N£  >  n*b,  P(N£  <  n)  >  0,  b  =  1, . . .  ,B. 
We  experienced  this  for  some  tables  when  using  the  mutual  independence  model, 
since  this  model  often  yields  small  iV-estimates.  Because  of  these  two  disadvantages 
of  this  bootstrap,  we  do  not  consider  it  further. 

5.2     Nn  and  the  Bootstrap 

In  view  of  the  discussion  in  the  last  section,  we  examine  a  bootstrap  based  on 
the  conditional  (on  n)  Nc  estimate.  Since  this  point  estimate  is  obtained  by  con- 
ditioning on  n,  we  bootstrap  from  an  estimate,  Fc,  of  Fc  =  mult(n,  7r'),  where 
{7rj  =  7Tj/X]iei7n}-  This  bootstrap  interval  will  always  satisty  Ulower  >  n  since 
each  resample  has  n  observed  subjects. 
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The  conditional  bootstrap  enjoys  the  advantage  of  estimating  the  generating  dis- 
tribution Fc  for  the  incomplete  table  entirely  from  the  observed  data.  The  non- 
parametric  conditional  bootstrap  is  a  true  nonparametric  bootstrap  in  that  it  strictly 
resamples  from  the  emprical  distribution  of  the  observed  data,  conditional  on  n.  It 
does  not  depend  on  the  assumed  model  as  does  Buckland  and  Garthwaite's  (1991) 
"nonparametric"  bootstrap  of  Section  2.3.2.  For  small  samples,  however,  this  non- 
parametric  bootstrap  has  the  disadvantage  of  assigning  zero  resampling  probability 
to  cells  with  zero  count. 

Table  5.5  reports  the  results  of  calculating  the  conditional  parametric  bootstrap 
on  each  of  500  24  tables  simulated  from  the  logistic-normal  model  with  /3  =  0.  We 
defer  the  mean  absolute  errors  of  Nc  until  profile  likelihood  results  are  presented 
in  the  next  section.  We  see  that  for  the  true  model,  the  logistic-normal  model,  the 
conditional  bootstrap  has  lower  coverage  than  the  bootstrap  based  on  N  when  a  is 
small,  but  has  higher  coverage  when  a  is  large.  This  is  because  of  Sanathanan's  (1972) 
comment  that  necessarily  Nc  >  N.  When  a  is  large,  n0...o  is  large  and  the  larger 
TV-estimate,  Nc,  is  closer  to  the  true  value.  When  a  is  small,  this  larger  TV-estimate 
tends  to  overestimate  N  relative  to  TV.  For  the  homogeneous  2-factor  interaction 
model,  the  conditional  parametric  bootstrap  has  coverage  similar  to  the  numerically 
optimized  bootstrap. 

The  most  important  advantage  of  the  conditional  bootstrap  is  its  more  accurate 
reflection  of  the  flat  profile  likelihoods  for  the  latent  class  model.  Table  5.5  reports  the 
enormous  median  widths  for  this  bootstrap.  We  see  that  most  of  these  intervals  are 
very  wide,  reflecting  no  practical  information  on  N.  These  intervals  reflect  the  flat  pro- 
file likelihoods  incurred  by  the  latent  class  model.  Figure  5.1  demonstrates  why  this 
bootstrap  is  more  likely  to  reflect  the  uncertainty  of  an  TV-estimate  produced  by  this 
model.  Compare  to  Figure  3.4.  Unlike  the  profiles  of -2  Log  L  as  functions  of  TV,  these 
profiles  do  not  suggest  one  value  for  the  TV-estimate  over  another.  A  resampled  table 
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Table  5.5.  Estimated  coverage  and  median  width  of  90%,  95%,  and  99%  conditional 
(on  n)  parametric  percentile  bootstrap  intervals  for  N  from  the  logistic-normal  (q  — 
10)  model,  the  homogeneous  2-factor  interaction  model,  and  the  quasi-symmetric 
latent  class  model  when  t  =  4  sample  capture-recapture  data  are  generated  from  the 
logistic-normal  model  with  (3  =  0 


Nominal 
Coverage 

Estimated  Coverage 
LN  H02   QLC 

Median  Width 

N      a 

LN 

H02 

QLC 

80   0 

90 

.696 

.792 

.696 

11.8 

11.1 

21633 

95 

.762 

.850 

.758 

15.1 

13.7 

29840 

99 

.844 

.940 

.846 

23.9 

19.4 

44664 

.5 

90 

.826 

.834 

.886 

14.5 

14.9 

22351 

95 

.900 

.910 

.918 

18.6 

18.7 

30796 

99 

.958 

.962 

.962 

28.5 

25.6 

45962 

1 

90 

.838 

.822 

.834 

26.1 

22.3 

23242 

95 

.892 

.878 

.980 

38.8 

28.8 

32370 

99 

.966 

.964 

.992 

59.8 

40.6 

48067 

320  0 

90 

.804 

.831 

.728 

18.9 

21.5 

30721 

95 

.748 

.868 

.760 

23.7 

25.8 

43550 

99 

860 

.948 

.848 

32.5 

34.7 

65877 

.5 

90 

.862 

.844 

.930 

27.7 

28.5 

38246 

95 

.914 

.908 

.962 

33.4 

34.5 

51512 

99 

.972 

.964 

.982 

44.4 

45.8 

74740 

1 

90 

.868 

.860 

.836 

48.2 

45.6 

194 

95 

.912 

.910 

.892 

59.4 

55.3 

1241 

99 

.976 

.972 

.953 

80.7 

71.9 

60264 

has  more  of  a  chance  to  produce  an  aberrant  Nc  estimate  than  it  does  an  aberrant 
N  estimate  since  the  -2  Log  L  profile  used  to  obtain  N  has  a  well-defined  minimum 
even  though  the  log-likelihood  surface  is  virtually  flat.  The  same  four  resampled  ta- 
bles that  produced  resampled  estimates  N*  =  (423.6, 443.4,  547.5, 629.7)  in  Figure  3.4 
produce  conditional  resampled  estimates  JV£  =  (1092.6,1179.8,3037.0,9903.8).  This 
bootstrap,  however,  still  has  the  potential  to  be  misleadingly  narrow  just  because 
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the  arbitrariness  of  the  resampled  statistics  could  by  chance  lead  to  resampled  values 
close  to  the  observed  iV-estimate. 
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Figure  5.1.  Deviance  (G2)  Profile  for  the  Observed  Hepatitis  Data  (Solid  Line)  and 
the  Same  Four  Resampled  Tables  Considered  in  Figure  3.4  (Dashed  Lines) 


Simulation  results  for  the  conditional  nonparametric  bootstrap  are  presented  in 
Table  5.6.  The  nonparametric  interval  also  reflects  the  flat  likelihoods  incurred  by 
the  latent  class  model.  In  contrast  to  the  bootstrap  based  on  N,  there  is  little 
difference  between  the  conditional  parametric  and  nonparametric  bootstraps  in  terms 
of  coverage  and  median  width.  Tables  5.5  and  5.6  do  suggest,  however,  a  slight 
advantage  for  H02  over  LN  for  the  conditional  bootstrap. 
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Table  5.6.  Estimated  coverage  and  median  width  of  90%,  95%,  and  99%  conditional 
(on  n)  nonparametric  percentile  bootstrap  intervals  for  N  from  the  logistic-normal 
(q  —  10)  model,  the  homogeneous  2-factor  interaction  model,  and  the  quasi-symmetric 
latent  class  model  when  t  =  4  sample  capture-recapture  data  are  generated  from  the 
logistic-normal  model  with  (3  =  0 


Nominal         Estimated  Coverage 


Median  Width 


N      a 

Coverage 

LN 

H02 

QLC 

LN 

H02 

QLC 

80   0 

90 

.648 

.770 

.670 

9.4 

11.2 

14251 

95 

.734 

.842 

.760 

12.3 

13.9 

23408 

99 

.840 

.936 

.850 

18.1 

19.3 

37896 

.5 

90 

.792 

.830 

.846 

14.3 

14.7 

27939 

95 

.870 

.906 

.902 

18.5 

18.6 

32015 

99 

.952 

.966 

.960 

27.2 

25.9 

46277 

1 

90 

.828 

.822 

.872 

26.4 

23.3 

24350 

95 

.898 

.878 

.942 

38.6 

29.4 

33805 

99 

.962 

.964 

.988 

62.3 

42.6 

48314 

320  0 

90 

.668 

.802 

.700 

16.7 

21.6 

22886 

95 

.716 

.876 

.740 

20.4 

26.1 

47453 

99 

.846 

.938 

.852 

28.1 

34.6 

57413 

.5 

90 

.838 

.842 

.886 

28.2 

29.1 

40135 

95 

.896 

.904 

.938 

33.6 

34.4 

53768 

99 

.970 

.974 

.976 

43.7 

45.5 

79306 

1 

90 

.858 

.850 

.840 

47.8 

45.1 

234 

95 

.920 

.916 

.895 

58.1 

54.3 

21911 

99 

.968 

.966 

.951 

81.8 

71.9 

65152 

Ill 


Table  5.7.  Estimated  coverage  and  median  width  of  90%,  95%,  and  99%  conditional 
(on  n)  nonparametric  percentile  bootstrap  intervals  (B=1000)  for  N  from  the  logistic- 
normal  (q  —  10)  model,  the  homogeneous  2-factor  interaction  model,  and  the  quasi- 
symmetric  latent  class  model  when  t  =  4  sample  capture-recapture  data  are  generated 
from  the  logistic-normal  model  with  f3  —  0 


Nominal         Estimated  Coverage 


Median  Width 


TV  a 

Coverage 

LN 

H02 

QLC 

LN 

H02 

QLC 

80   0 

90 

.655 

.805 

.685 

13.4 

11.5 

9288 

95 

.735 

.870 

.745 

17.6 

14.3 

18797 

99 

.825 

.945 

.835 

29.7 

21.1 

35078 

.5 

00 

.800 

.830 

.805 

20.9 

16.4 

23224 

95 

.850 

.885 

.865 

28.4 

20.1 

32534 

99 

.945 

.970 

.950 

51.0 

29.5 

49027 

1 

90 

.850 

.850 

.880 

32.7 

25.1 

19694 

95 

.915 

.910 

.950 

47.6 

31.7 

29024 

99 

.965 

.965 

.990 

67.9 

46.1 

48470 

320  0 

90 

.630 

.825 

.645 

18.9 

22.3 

21242 

95 

.725 

.885 

.755 

23.2 

26.9 

34847 

99 

.845 

.945 

.855 

32.7 

36.1 

65111 

.5 

90 

.840 

.845 

.905 

28.2 

28.8 

38154 

95 

.920 

.915 

.935 

33.8 

34.8 

53618 

99 

.970 

.975 

.980 

46.1 

47.3 

84162 

1 

90 

.840 

.845 

.855 

55.8 

45.8 

143 

95 

.920 

.920 

.915 

70.5 

55.4 

21466 

99 

.970 

.970 

.948 

105.8 

74.8 

64926 
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We  have  simply  used  these  intervals  to  demonstrate  the  relative  performances  of 
the  different  assumed  models  when  the  logistic-normal  model  holds.  As  discussed 
earlier  in  this  section,  these  bootstrap  intervals  are  very  crude  because  we  must  use 
a  small  number  of  resamples  (B  =  200)  in  simulation.  We  checked  to  see  if  larger 
B  would  significantly  change  the  results  reported  in  Table  5.6  by  re-running  the 
parameter  settings  in  the  table  using  B  =  1000  for  200  simulated  tables  instead  of 
B  =  200  for  1000  simulated  tables.  Table  5.7  reports  the  results.  We  see  that  the 
simulated  coverage  probabilities  do  not  change  significantly  when  we  increase  the 
number  of  resamples  to  1000  in  this  case. 

5.2.1     BCn  Versus  Percentile  Bootstrap 

We  also  ran  a  limited  simulation  study  comparing  the  BCa  and  percentile  forms  of 
this  conditional  bootstrap.  Because  of  the  complex  computations  needed  for  the  BCa 
interval,  we  designed  this  simulation  following  the  design  of  Olkin  et  al.(1981)  in  the 
i.i.d.  Binomial  case.  Instead  of  fixing  N,  a,  and  3  for  an  underlying  logistic-normal 
model  and  running  1000  simulations,  we  randomly  generated  these  values  uniformly 
over  appropriate  ranges  and  ran  one  simulation  at  each  parameter  combination.  Olkin 
et  al.  (1981)  argue  that  this  design  better  indicates  how  well  the  methods  perform  in 
a  wide  variety  of  scenarios. 

The  elements  of  3  were  generated  by  first  randomly  generating  a  mean  value 
for  the  4  elements,  /ia,  and  then  separately  generating  an  element's  deviation  from 

this  overall  mean.  Due  to  the  computational  complexity  of  the  BCa  intervals,  we 
generated  200  24  tables  uniformly  from  the  ranges  50  <  N  <  320,  0  <  a  <  2.5, 
— 2  <  fj,a  <  2,  and  —  .5  <  fy ;  —  \x$  <  .5.  We  compared  these  interval  estimates  for 

both  the  logistic-normal  model  and  the  log-linear  model  of  homogeneous  two-factor 
interaction. 


113 

Table  5.8  reports  the  results.  When  considering  a  wide  variety  of  parameter 
settings,  we  see  that  the  true  model,  the  logistic-normal  model,  has  a  slight  advantage 
over  the  log-linear  model  with  respect  to  coverage,  at  the  expense  of  wider  intervals. 
The  results  suggest  that  the  BCa  intervals  are  slightly  wider  than  their  percentile 
counterparts,  but  the  resulting  coverages  appear  to  be  almost  equal.  It  would  be 
desirable  to  run  further  comparisons  with  more  simulated  tables,  which  will  soon  be 
feasible  with  faster  computing  facilities. 

Table  5.8.  Simulated  coverage  and  median  widths  of  95%  percentile  and  BCa  boot- 
strap intervals  based  on  Nq  when  t  —  4  sample  capture-recapture  data  are  generated 
by  the  logistic-normal  model  with  randomly  generated  (N,  a,  f3) 


Model 

Simulated  Coverage 
Percent.         BCa 

Median  Width 
Percent.      BCa 

LN 
H02 

.945             .920 
.890            .910 

172.5       175.3 
129.9       140.0 

5.3      Nr 

and  the  Profile  Likelihood  Confidence  Interval 

The  computational  ease  of  the  profile  likelihood  interval  relative  to  the  bootstrap 
intervals  allows  us  to  investigate  these  confidence  intervals  at  many  more  model  and 
parameter  combinations.  This  computational  simplification  occurs  since  the  number 
of  model  fits  needed  to  locate  the  n0...o  values  that  satisfy  G2(no...o)  =  G2(n0...o)  +  Xi  a 
is  usually  much  less  than  the  number  of  bootstrap  resamples.  Using  1000  24  tables 
at  each  combination  of  study  factors,  we  estimated  the  mean  width,  median  width, 
and  coverage  probability  of  the  profile  likelihood  interval  as  well  as  the  median  error, 
Nc  —  N,  and  absolute  error,  Nc  -  N  ,  of  Nc.  For  most  models,  we  also  report  the 
two-sided  coverages;  that  is,  the  percentage  of  tables  for  which  N  falls  below  (lower 
tail)  and  above  (upper  tail)  the  lower  and  upper  confidence  limits,  respectively.  When 
assuming  the  latent  class  model,  we  consider  the  mean  and  median  absolute  error  to 
demonstrate  the  effect  of  the  flat  deviance  profiles.   We  first  considered  underlying 


114 

models  for  which  population  heterogeneity  was  the  only  source  of  sample  dependence. 
This  simulation  study  used  the  following  factors  in  a  factorial  design,  with  the  levels 
indicated,  for  /,  =  4. 

1.  iV  =  80,320 

2.  Underlying  Model  Form  (Parameter  Settings): 

(a)  Logistic-normal  Model  (3.6)  (a  =  0.0,0.5, 1.0;  /3  =  (0,  -1)) 

(b)  Quasi-symmetric  Latent  Class  Model  (3.20)  (a  =  0.5,1.0;  (3  =  0,-1; 
v  =  (.5,  .5),  (.75,  .25)) 

(c)  Log-linear  Model  (3.5)  of  Homogeneous  Two- Factor  Interaction  (A  =  0.25, 0.5; 
/3  =  0,-l) 

3.  Assumed  Model:  Logistic-Normal  (q  =  10),  H02,  QLC,  Mutual  Independence, 
SE,  H02SE,  and  MIXED  SE 

The  three  a  values  in  the  logistic-normal  models  represent  no,  moderate,  and  large 
amounts  of  population  heterogeneity,  while  /3  —  0  and  (3  —  —  1  represent  moderate 
and  small  probabilities  of  capture  for  the  t  sampling  occasions,  respectively.  The 
two  settings  for  v  for  the  latent  class  model  represent  symmetric  and  skewed  latent 
distributions,  a  =  0  and  A  =  0  were  omitted  when  assuming  the  latent  class  and  H02 
model,  respectively,  since  these  cases  correspond  to  the  logistic-normal  model  with 
<7  =  0.  We  also  treated  the  quasi-symmetric  latent  class  separately  by  also  considering 
its  performance  for  t  =  3  and  t  =  5  in  order  to  investigate  the  implications  of  Lindsay 
et  al.'s  (1991)  results  in  the  capture-recapture  setting. 

Secondly,  we  considered  the  performances  of  the  above  assumed  models,  along 
with  the  mixed  serial  dependence  model  of  Section  4.1.1  when  serial  dependence  model 
(4.1)  holds  for  t  —  4  and  N  —  320.  We  considered  all  combinations  of  a  =  0.0, 1.0  and 
7  =  —1.0,-0.5,0.5,1.0.   Thus,  we  consider  the  cases  of  no  heterogeneity  and  large 
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amounts  of  population  heterogeneity  coupled  with  both  negative  and  positive  within- 
subject  dependence.  This  within-subject  dependence  represents  trap-avoidance  when 
7  is  negative  and  trap-dependence  when  7  is  positive. 

5.3.1     Model  Comparison 

We  reserve  consideration  of  the  QLC  model  for  a  separate  detailed  study  of  its 
flat  profile  likelihoods.  Results  for  the  other  assumed  models  are  presented  in  Ta- 
bles 5.9-5.20,  each  table  corresponding  to  a  particular  (underlying  model  form,  (3) 
combination. 

Underlying  Logistic-Normal  and  Latent  Class  Models 

Consider  first  the  results  in  Tables  5.9-5.14  when  the  underlying  model  is  either 
the  logistic-normal  model  or  the  latent  class  model.  We  see  comparisons  between 
the  different  assumed  models  similar  to  those  demonstrated  by  the  bootstrap.  The 
mutual  independence  model  is  clearly  inadequate  in  the  presence  of  heterogeneity, 
yielding  narrow  intervals  that  almost  always  underestimate  N.  Unlike  the  bootstrap, 
however,  the  profile  likelihood  coverage  for  the  mutual  independence  model  is  close 
to  the  nominal  level  when  N  is  large  (320)  and  the  mutual  independence  model  is  the 
true  model.  This  provides  evidence  that  the  low  coverages  for  the  bootstrap  when 
a  =  0  in  Table  5.1  is  a  consequence  of  the  interval  and  not  the  model.  This  model's 
coverage  degradation  is  not  as  rapid  as  a  increases  when  the  latent  class  model  is  the 
true  underlying  model  since  the  heterogeneity  implied  by  this  model  for  a  given  a  is 
not  as  severe  as  that  implied  by  the  continuous  mixture  model. 

As  it  does  with  the  bootstrap,  H02  performs  better  than  the  logistic-normal  model 
when  a  large  amount  of  heterogeneity  exists  and  the  sampling  occasion  parameters  are 
negative.  Thus,  in  capture-recapture  experiments  with  small  probability  of  capture 
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and/or  large  amounts  of  heterogeneity,  the  H02  model  avoids  the  flat  likelihood 
problems  encountered  by  the  logistic-normal  model.  This  yields  intervals  that  can 
be  only  one-fourth  as  long  as  the  logistic-normal  intervals,  while  maintaining  close- 
to-nominal  coverage.  When  the  true  model  is  the  latent  class  model,  there  is  not  as 
much  of  a  distinct  advantage  for  H02,  but  this  model  continues  to  produce  much 
narrower  intervals  with  close-to-nominal  coverage. 

The  addition  of  a  serial  dependence  term  to  the  mutual  independence  model  im- 
proves that  model's  performance  somewhat,  but  we  still  see  serious  coverage  degra- 
dation as  heterogeneity  increases.  This  is  not  a  surprise  since  the  serial  dependence 
model  assumes  a  lack  of  population  heterogeneity.  Evidently,  this  dependence  term 
accounts  for  some  dependence  caused  by  population  heterogeneity,  but  not  enough 
when  this  heterogeneity  is  severe.  Adding  the  extra  serial  dependence  term  to  H02 
when  the  true  model  is  logistic  normal  or  the  latent  class  model  does  not  lengthen  the 
intervals  noticeably,  yet  maintains  coverage  close  to  nominal  level  when  the  logistic- 
normal  model  holds  with  N  =  80  and  /3  =  0,  settings  for  which  H02's  coverage  dips 
well  below  nominal  level.  Thus,  these  results  suggest  that  adding  the  serial  depen- 
dence term  to  the  log-linear  model  of  homogeneous  two-factor  interaction  even  when 
the  sole  source  of  sample  dependence  is  population  heterogeneity  is  worthwhile.  This 
model  maintains  close-to-nominal  coverage  for  all  simulated  settings  while  producing 
intervals  usually  only  slightly  wider  than  those  produced  by  the  model  with  no  serial 
dependence  term. 

Underlying  HQ2  Model 

Tables  5.15  and  5.16  present  the  results  when  the  underlying  model  is  the  log- 
linear  model  of  homogeneous  two-factor  interaction.  When  the  capture  probabilities 
are  large  ((3  —  0),  the  intervals  produced  by  all  assumed  models  are  overly  narrow. 
This  is  because  a  positive  A  value  implies  that  almost  all  of  the  subjects  will  be 


117 


Table  5.9.  Median  error  and  absolute  error  of  Nc  and  coverage  probabilities  (lower 
and  upper  tails  in  parentheses),  mean  widths  and  median  widths  for  95%  profile  like- 
lihood confidence  intervals  when  t  -  4  sample  capture-recapture  data  are  generated 
from  the  logistic-normal  model  with  (3  =  0 


Assumed 

Mean 

Median 

Median 

Median 

N       a 

Model 

Coverage 

Width 

Width 

Err. 

Abs.  Err. 

80     0.0 

LN10 

.946  (.048,  .006) 

23.0 

17.5 

1.2 

2.4 

H02 

.920  (.060,  .020) 

20.2 

17.6 

0.3 

2.5 

SE 

.951  (.028,  .021) 

13.7 

13.1 

0.1 

2.1 

H02SE 

.955  (.027,  .018) 

21.1 

17.9 

0.3 

2.5 

IND 

.918  (.054,  .028) 

10.4 

10.4 

0.1 

1.8 

0.5 

LN10 

.953  (.033,  .014) 

35.4 

23.8 

0.3 

3.1 

1102 

.912  (.068,  .020) 

26.1 

22.5 

0.1 

3.4 

SE 

.924  (.010,  .066) 

13.8 

12.9 

-1.6 

2.7 

H02SE 

.947  (.029,  .024) 

27.5 

23.5 

0.1 

3.3 

IND 

.832  (.010,  .158) 

9.4 

9.4 

-2.3 

2.6 

1.0 

LN10 

.958  (.023,  .019) 

63.2 

47.1 

0.0 

5.0 

H02 

.889  (.090,  .021) 

38.1 

33.1 

-0.1 

4.9 

SE 

.723  (.000,  .277) 

14.0 

13.0 

-5.7 

5.8 

H02SE 

.957  (.024,  .019) 

42.3 

35.4 

0.0 

5.0 

IND 

.244  (.000,  .756) 

7.5 

7.5 

-7.3 

7.5 

320     0.0 

LN10 

.955  (.040,  .005) 

32.0 

30.0 

1.9 

4.3 

H02 

.950  (.028,  .022) 

33.6 

32.1 

-0.1 

5.5 

SE 

.954  (.029,  .017) 

25.4 

25.1 

-0.1 

3.9 

H02SE 

.949  (.029,  .022) 

33.7 

32.2 

-0.1 

5.5 

IND 

.966  (.018,  .016) 

21.3 

21.2 

-0.2 

3.5 

0.5 

LN10 

.954  (.031,  .015) 

44.2 

42.2 

0.4 

6.9 

H02 

.949  (.031,  .020) 

43.7 

41.9 

0.3 

7.0 

SE 

.835  (.003,  .162) 

25.7 

25.3 

-6.9 

7.2 

H02SE 

.949  (.032,  .019) 

43.8 

42.0 

0.5 

7.0 

IND 

.561  (.000,  .439) 

19.2 

19.1 

-9.7 

9.7 

1.0 

LN10 

.952  (.025,  .023) 

73.8 

66.5 

-0.5 

10.3 

H02 

.951  (.025,  .024) 

64.9 

62.6 

-0.6 

10.2 

SE 

.192  (.000,  .808) 

25.4 

25.1 

-23.1 

23.1 

H02SE 

.952  (.025,  .023) 

65.1 

62.4 

0.6 

10.2 

IND 

.000  (.000,  1.00) 

15.2 

15.1 

-30.6 

30.6 
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Table  5.10.  Median  error  and  absolute  error  of  Nc  and  coverage  probabilities  (lower 
and  upper  tails  in  parentheses),  mean  widths  and  median  widths  for  95%  profile  like- 
lihood confidence  intervals  when  t  =  A  sample  capture-recapture  data  are  generated 
from  the  logistic-normal  model  with  /3  =  —  1 


Assumed 

Mean 

Median 

Median 

Median 

N        a 

Model 
LN10 

Coverage 

Width 

Width 

Err. 

Abs.  Err. 

80     0.0 

.944  (.053,  .003) 

476.5 

135.9 

5.7 

8.8 

H02 

.949  (.027,.024) 

135.8 

99.5 

0.3 

12.4 

SE 

.955  (.031,  .014) 

60.2 

50.5 

0.8 

7.6 

H02SE 

.951  (.028,  .021) 

146.2 

103.4 

0.0 

12.3 

IND 

.952  (.022,  .026) 

37.8 

35.9 

0.0 

5.6 

0.5 

LN10 

.963  (.032,  .005) 

328.0 

178.0 

1.8 

10.2 

H02 

.951  (.025,.024) 

119.5 

95.5 

0.1 

12.4 

SE 

.929  (.005,  .066) 

49.5 

42.4 

-4.6 

8.0 

H02SE 

.954  (.024,  .022) 

129.5 

100.2 

0.2 

12.7 

IND 

.850  (.006,  .144) 

29.1 

27.9 

-6.4 

7.3 

1.0 

LN10 

.966  (.022,  .012) 

301.4 

285.5 

-1.1 

13.1 

H02 

.963  (.019,.018) 

111.6 

88.3 

-0.1 

12.0 

SE 

.712  (.000,  .288) 

34.2 

29.4 

-13.3 

13.4 

H02SE 

.966  (.019,  .015) 

120.6 

92.3 

0.0 

12.3 

IND 

.232  (.000,  .768) 

17.6 

16.9 

-16.6 

16.6 

320     0.0 

LN10 

.951  (.048,  .001) 

177.8 

142.9 

9.9 

17.4 

H02 

.954  (.022,.024) 

171.6 

158.5 

-0.1 

25.6 

SE 

.941  (.032,  .027) 

94.5 

91.5 

-0.5 

15.8 

H02SE 

.953  (.022,  .025) 

173.5 

161.3 

-1.8 

25.7 

IND 

.950  (.031,  .019) 

70.3 

69.0 

-1.3 

12.5 

0.5 

LN10 

.960  (.019,  .021) 

193.0 

167.9 

-0.4 

22.1 

H02 

.951  (.018,-031) 

163.4 

156.0 

0.3 

24.1 

SE 

.803  (.001,  .196) 

77.3 

75.4 

-21.7 

23.4 

H02SE 

.949  (.020,  .031) 

165.1 

157.6 

-1.0 

24.1 

IND 

.566  (.000,  .434) 

54.9 

54.5 

-27.4 

27.4 

1.0 

LN10 

.953  (.023,  .024) 

287.7 

190.7 

-2.1 

27.3 

H02 

.956  (.014,-030) 

156.8 

148.6 

-0.6 

24.4 

SE 

.150  (.000,  .850) 

55.4 

54.2 

-54.7 

54.7 

E02SE 

.957  (.014,  .029) 

158.2 

150.3 

-5.9 

24.6 

IND 

.000  (.000,  1.00) 

33.8 

33.5 

-68.0 

67.9 
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Table  5.11.  Median  error  and  absolute  error  of  Nc  and  coverage  probabilities  (lower 
and  upper  tails  in  parentheses),  mean  widths  and  median  widths  for  95%  profile  like- 
lihood confidence  intervals  when  t  =  4  sample  capture-recapture  data  are  generated 
from  the  QLC  model  with  v  =  (.5,  .5)  and  (3  =  0 


N 


a 


Assumed 
Model 


Coverage 


Mean     Median     Median      Median 
Width     Width        Err.        Abs.  Err. 


80     0.5 

LN10 

.951 

(.044, 

.005) 

16.3 

13.8 

0.8 

1.7 

H02 

.944 

[.037, 

.019) 

15.3 

13.8 

0.3 

1.8 

SE 

.949 

[.032, 

.019) 

9.9 

9.4 

-0.1 

1.5 

H02SE 

.940 

[.040, 

.020) 

15.5 

13.8 

0.3 

1.8 

IND 

.933 

(.027, 

.040) 

7.5 

7.4 

-0.4 

1.4 

1.0 

LN10 

.941 

[.050, 

.009) 

16.3 

12.5 

0.5 

1.6 

H02 

.940 

(.047, 

.013) 

14.4 

12.7 

0.4 

1.6 

SE 

.936 

(.026, 

.038) 

7.6 

7.1 

-0.5 

1.3 

H02SE 

.940 

(.047, 

.013) 

14.5 

12.7 

0.4 

1.6 

IND 

.871 

(.014, 

.115) 

5.1 

5.0 

-1.0 

1.3 

320     0.5 

LN10 

.950 

(.040, 

.010) 

24.4 

23.6 

0.8 

3.3 

H02 

.939 

(.037, 

.024) 

24.7 

24.3 

0.5 

3.8 

SE 

.947 

(.017, 

.036) 

18.3 

18.2 

-0.9 

3.3 

H02SE 

.939 

(.038, 

.023) 

25.1 

24.3 

0.5 

3.7 

IND 

.943 

(.007, 

.050) 

15.1 

15.1 

-1.0 

2.9 

1.0 

LN10 

.944 

(.042, 

.014) 

22.9 

22.0 

1.2 

3.7 

H02 

.943 

(.043, 

.014) 

23.2 

22.3 

1.3 

3.7 

SE 

.899 

(.007, 

.094) 

14.3 

14.1 

-2.5 

3.2 

H02SE 

.944 

(.043, 

.015) 

113.9 

107.8 

1.3 

17.0 

IND 

.687 

(.000, 

.313) 

10.6 

10.6 

-4.3 

4.3 
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Table  5.12.  Median  error  and  absolute  error  of  Nc  and  coverage  probabilities  (lower 
and  upper  tails  in  parentheses),  mean  widths  and  median  widths  for  95%  profile  like- 
lihood confidence  intervals  when  t  —  4  sample  capture-recapture  data  are  generated 

from  the  QLC  model  with  v  =  (.5,  .5)  and  (3  =  -1 

Assumed  Mean     Median     Median       Median 

N       a        Model  Coverage  Width     Width        Err.        Abs.  Err. 


80     0.5 

LN10 

.955 

;.041,  .004) 

157.1 

72.9 

2.8 

6.8 

H02 

.943 

(.027,  .030) 

78.5 

64.8 

-0.7 

8.7 

SE 

.935 

;.026,  .039) 

39.2 

35.3 

-0.8 

5.8 

H02SE 

.943 

(.029,  .028) 

81.7 

66.1 

-0.5 

8.5 

IND 

.932 

;.022,  .046) 

26.1 

25.3 

-1.7 

4.6 

1.0 

LN10 

.951 

[.034,  .015) 

112.2 

53.0 

0.3 

5.8 

H02 

.933 

;.029,  .038) 

55.1 

46.2 

-0.3 

6.7 

SE 

.909 

(.006,  .085) 

25.1 

23.1 

-3.4 

5.1 

H02SE 

.930 

(.032,  .038) 

56.6 

47.0 

-0.3 

6.7 

IND 

.811 

(.005,  .184) 

16.7 

16.2 

-4.9 

5.1 

320    0.5 

LN10 

.964 

(.032,  .004) 

112.7 

98.8 

2.8 

13.0 

H02 

.947 

(.024,  .029) 

113.1 

107.0 

-2.2 

17.0 

SE 

.937 

(.013,  .050) 

66.0 

64.7 

-4.8 

11.3 

H02SE 

.944 

(.026,  .030) 

113.9 

107.8 

-1.8 

17.0 

IND 

.908 

(.009,  .083) 

49.7 

49.1 

-7.1 

11.0 

1.0 

LN10 

.942 

(.025,  .033) 

85.5 

81.2 

-1.9 

13.2 

H02 

.934 

(.025,  .041) 

81.7 

79.2 

-2.2 

13.2 

SE 

.771 

(.001,  .228) 

44.3 

43.7 

-15.3 

15.7 

H02SE 

.933 

(.026,  .041) 

82.1 

79.1 

-2.0 

13.2 

IND 

.451 

(.000,  .549) 

32.5 

32.4 

-19.3 

19.3 
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Table  5.13.  Median  error  and  absolute  error  of  Nc  and  coverage  probabilities  (lower 
and  upper  tails  in  parentheses),  mean  widths  and  median  widths  for  95%  profile  like- 
lihood confidence  intervals  when  t  =  4  sample  capture-recapture  data  are  generated 
from  the  QLC  model  with  v  =  (.75,  .25)  and  (3  =  0 


N 


(7 


Assumed 
Model 


Coverage 


Mean     Median     Median      Median 
Width     Width        Err.        Abs.  Err. 


80     0.5 

LN10 

.954 

[.040, 

.006) 

19.6 

16.1 

0.8 

1.9 

H02 

.941 

[.035, 

.025) 

18.2 

16.2 

0.2 

2.1 

SE 

.957 

[.020, 

.023) 

11.6 

11.1 

-0.1 

1.8 

H02SE 

.938 

[.037, 

.025) 

18.4 

16.2 

0.3 

2.1 

IND 

.945 

[.014, 

.041) 

8.9 

8.8 

-0.3 

1.6 

1.0 

LN10 

.941 

[.052, 

.007) 

20.9 

16.2 

0.8 

2.1 

H02 

.936 

[.048, 

.016) 

18.8 

16.2 

0.5 

2.2 

SE 

.936 

[.022, 

.042) 

10.4 

9.8 

-0.3 

1.8 

H02SE 

.937 

[.047, 

.016) 

19.0 

16.4 

0.6 

2.3 

IND 

.897 

[.015, 

.088) 

7.4 

7.3 

-1.0 

1.5 

320     0.5 

LN10 

.948 

[.043, 

.009) 

28.8 

27.5 

1.4 

4.1 

H02 

.940 

[.039, 

.021) 

29.7 

28.8 

0.7 

4.5 

SE 

.950 

[.019, 

.031) 

21.7 

21.5 

-0.8 

3.6 

H02SE 

.939 

[.040, 

.021) 

29.7 

28.8 

0.7 

4.5 

IND 

.949 

[.008, 

.043) 

17.8 

17.8 

-1.5 

3.3 

1.0 

LN10 

.932 

[.058, 

.010) 

31.0 

29.9 

2.5 

4.7 

H02 

.926 

[.058, 

.016) 

31.1 

30.0 

2.4 

4.8 

SE 

.941 

[.008, 

.051) 

19.5 

19.3 

-2.1 

3.8 

H02SE 

.926 

[.059, 

.015) 

30.9 

30.0 

2.5 

4.8 

IND 

.828 

[.001, 

.171) 

14.9 

14.9 

-4.1 

4.3 

122 


Table  5.14.  Median  error  and  absolute  error  of  Nc  and  coverage  probabilities  (lower 
and  upper  tails  in  parentheses),  mean  widths  and  median  widths  for  95%  profile  like- 
lihood confidence  intervals  when  t  =  4  sample  capture-recapture  data  are  generated 
from  the  QLC  model  with  v  =  (.75,  .25)  and  /3  =  —  1 


N 


a 


Assumed 

Model 


Coverage 


Mean     Median     Median       Median 
Width     Width         Err.        Abs.  Err. 


80     0.5 

LN10 

.955 

(.041, 

.004) 

267.1 

101.4 

4.0 

7.6 

H02 

.950 

(.022, 

.028) 

101.0 

80.3 

0.0 

9.6 

SE 

.939 

(.038, 

.031) 

48.0 

42.0 

-0.3 

6.3 

H02SE 

.951 

(.023, 

.026) 

107.2 

82.7 

0.4 

9.7 

IND 

.942 

(.019, 

.039) 

30.6 

29.3 

-1.3 

13.9 

1.0 

LN10 

.948 

(.048, 

.004) 

201.0 

97.8 

3.5 

7.5 

H02 

.945 

(.039, 

.016) 

89.5 

72.8 

2.1 

8.8 

SE 

.937 

(.016, 

.047) 

37.4 

33.3 

-3.0 

5.9 

H02SE 

.944 

(.041, 

.015) 

93.3 

74.5 

2.6 

9.0 

IND 

.870 

(.007, 

.123) 

23.3 

22.5 

-4.7 

11.9 

320    0.5 

LN10 

.961 

(.036, 

.003) 

144.3 

122.4 

5.9 

16.0 

H02 

.941 

(.030, 

.029) 

140.0 

132.5 

-0.7 

21.4 

SE 

.941 

(.020, 

.039) 

78.3 

76.5 

-4.9 

13.5 

H02SE 

.940 

(.031, 

.029) 

141.2 

133.9 

-0.3 

21.7 

IND 

.934 

(.009, 

.057) 

57.7 

57.5 

-6.7 

11.9 

1.0 

LN10 

.947 

(.039, 

.014) 

143.4 

128.4 

5.9 

18.4 

H02 

.939 

(.039, 

.022) 

126.7 

120.7 

5.5 

18.7 

SE 

.857 

(.005, 

.138) 

62.4 

61.0 

-13.1 

15.7 

H02SE 

.937 

(.041, 

.022) 

127.6 

121.6 

5.9 

18.8 

IND 

.646 

(.000, 

.354) 

44.5 

44.1 

-19.9 

25.6 
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captured  many  times,  leaving  very  few  subjects  remaining  uncaptured  after  t  samples 
or  captured  only  once.  This  pattern  in  the  observed  table  provides  greater  certainty 
that  the  unobserved  cell  count  is  very  small,  leading  to  point  estimates  that  are  close 
to  N  and  narrow  interval  estimates. 

The  only  assumed  model  that  is  competitive  with  the  true  models,  H02  and 
H02SE,  with  respect  to  coverage  at  all  simulated  parameter  settings  is  the  logistic- 
normal  model.  Table  5.16,  however,  shows  that  like  its  performance  in  the  previous 
section,  this  model  produces  intervals  that  are  over  twice  as  wide  as  those  given  by  the 
simpler  log-linear  models  when  the  probability  of  capture  is  small  ((3  —  — 1).  Thus, 
the  H02  and  H02SE  log-linear  models  are  again  preferable  to  the  mixed  model,  which 
is  not  surprising  since  they  are  the  correct  model  in  this  case. 

Underlying  Serial  Dependence  Model  (4.1) 

The  most  interesting  results  are  perhaps  those  observed  when  the  true  model  is  se- 
rial dependence  model  (4.1).  Tables  5.17-5.20  report  the  results.  The  logistic-normal 
model  cannot  accurately  estimate  N  when  there  exists  overall  negative  dependence 
among  the  t  samples,  as  evidenced  by  its  simulated  zero  and  near-zero  coverages  when 
(a,  7)  =  (0.0,  -1.0),  (0.0,-0.5),  and  (1.0,  -1.0).  As  anticipated  by  Section  4.3,  the  lines 
for  this  model  and  mutual  independence  are  identical  when  there  is  strictly  negative 
dependence  among  the  t  occasions  because  the  logistic-normal  fit  on  the  boundary 
(a  =  0)  is  the  mutual  independence  fit.  Thus,  if  trap-avoidance  exists  within  the 
population,  the  logistic-normal  model  will  overestimate  AT  unless  strong  positive  de- 
pendence caused  by  a  strongly  heterogeneous  population  produces  an  overall  positive 
dependence  structure  among  the  t  responses.  In  light  of  the  discussions  in  Section  4.3, 
this  failure  of  the  logistic-normal  model  is  to  be  expected  since  it  cannot  describe  a 
negative  dependence  structure  among  the  t  responses. 
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Table  5.15.  Median  error  and  absolute  error  of  Nc  and  coverage  probabilities  (lower 
and  upper  tails  in  parentheses),  mean  widths  and  median  widths  for  95%  profile  like- 
lihood confidence  intervals  when  t  =  A  sample  capture-recapture  data  are  generated 
from  the  log-linear  model  of  homogeneous  two-factor  interaction  with  (3  =  0 


N 


a 


Assumed 
Model 


Coverage 


Mean     Median     Median      Median 
Width      Width         Err.        Abs.  Err. 


80      .25 

LN10 

.942 

(.044, 

.014) 

27.2 

13.1 

1.5 

1.8 

H02 

.938 

(.045, 

.017) 

15.3 

13.3 

0.2 

1.9 

SE 

.924 

(.014, 

.062) 

7.8 

7.3 

0.5 

1.5 

H02SE 

.940 

(.045, 

.015) 

15.3 

13.4 

0.2 

1.9 

IND 

.850 

(.003, 

.147) 

5.2 

5.0 

0.5 

1.5 

.50 

LN10 

.946 

(.035, 

.019) 

9.6 

8.0 

2.7 

1.1 

H02 

.945 

(.038, 

.017) 

10.6 

8.7 

0.4 

1.1 

SE 

.885 

(.000, 

.115) 

3.7 

3.4 

1.5 

0.9 

H02SE 

.945 

(.037, 

.018) 

10.5 

8.7 

0.5 

1.1 

IND 

.648 

(.000, 

.352) 

1.9 

1.9 

1.9 

0.8 

320     .25 

LN10 

.954 

(.024, 

.022) 

23.9 

23.2 

3.7 

3.6 

H02 

.955 

(.024, 

.021) 

24.2 

23.5 

0.3 

3.7 

SE 

.823 

(.001, 

.176) 

14.4 

14.2 

1.6 

4.3 

H02SE 

.954 

(.024, 

.022) 

24.2 

23.5 

0.4 

3.7 

IND 

.487 

(.000, 

.513) 

10.6 

10.6 

2.3 

6.1 

.50 

LN10 

.938 

(.024, 

.038) 

14.4 

13.8 

8.5 

2.4 

H02 

.943 

(.026, 

.031) 

15.8 

14.9 

0.3 

2.5 

SE 

.632 

(.001, 

.367) 

7.0 

6.8 

5.6 

3.5 

H02SE 

.943 

(.026, 

.031) 

15.7 

14.9 

0.4 

2.5 

IND 

.180 

(.000, 

.820) 

3.8 

3.8 

7.6 

4.9 
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Table  5.16.  Median  error  and  absolute  error  of  Nc  and  coverage  probabilities  (lower 
and  upper  tails  in  parentheses),  mean  widths  and  median  widths  for  95%  profile  like- 
lihood confidence  intervals  when  t  =  4  sample  capture-recapture  data  are  generated 
from  the  log-linear  model  of  homogeneous  two-factor  interaction  with  /3  =  —  1 


N 


Assumed 
a        Model 


Coverage 


Mean      Median     Median      Median 
Width     Width        Err.        Abs.  Err. 


80     .25 

LN10 

.946 

(.025, 

.029) 

191.9 

92.4 

5.3 

8.1 

H02 

.945 

[.025, 

.030) 

86.5 

71.6 

-0.4 

9.5 

SE 

.908 

(.003, 

.089) 

36.2 

31.9 

1.7 

7.3 

H02SE 

.948 

[.026, 

.026) 

91.6 

74.0 

0.3 

9.7 

1ND 

.795 

[.000, 

.205) 

22.6 

21.9 

1.8 

7.1 

.50 

LN10 

.955 

(.025, 

.020) 

146.7 

65.3 

8.3 

7.6 

H02 

.961 

(.018, 

.021) 

60.0 

52.4 

-0.6 

7.2 

SE 

.724 

(.001, 

.275) 

21.0 

18.9 

3.9 

7.8 

H02SE 

.962 

(.017, 

.021) 

61.7 

53.5 

0.1 

7.4 

IND 

.288 

(.000, 

.712) 

11.8 

11.6 

5.1 

10.0 

320     .25 

LN10 

.953 

(.027, 

.020) 

149.7 

131.1 

12.0 

19.5 

H02 

.949 

(.025, 

.026) 

128.5 

121.2 

-0.3 

19.3 

SE 

.763 

(.000, 

.237) 

61.5 

59.2 

4.7 

22.1 

H02SE 

.952 

(.026, 

.022) 

129.5 

122.5 

0.1 

19.4 

IND 

.404 

(.000, 

.596) 

43.2 

42.8 

5.7 

27.5 

.50 

LN10 

.951 

(.028, 

.021) 

110.3 

102.3 

23.3 

15.7 

H02 

.954 

(.022, 

.024) 

93.5 

89.5 

0.0 

15.0 

SE 

.224 

(.000, 

.776) 

37.0 

35.9 

5.7 

31.5 

H02SE 

.953 

(.023, 

.024) 

94.0 

90.2 

0.7 

14.7 

IND 

.003 

(.000, 

.997) 

23.1 

22.9 

17.7 

40.9 
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When  both  positive  within-subject  dependence  and  population  heterogeneity  ex- 
ist, we  see  the  wide  intervals  that  are  indicative  of  flat  likelihood  surfaces.  These 
surfaces  caused  essentially  infinite  intervals.  The  profile  likelihood  intervals  were 
computed  by  searching  along  TV-values  in  increments  of  10,  with  the  maximum  num- 
ber of  increments  being  1000.  This  means  that  if  the  deviance  for  a  simulated  table 
had  not  increased  by  3.84  by  the  end  of  the  search,  the  upper  endpoint  of  that  interval 
is  at  least  N  +  10,000.  We  experienced  these  censored  intervals  using  the  logistic- 
normal  model  when  7  is  positive  and  fi  —  — 1.  In  these  cases,  Tables  5.19  and  5.20 
do  not  report  the  mean  length  of  the  logistic-normal  intervals  since  it  is  unknown, 
but  instead  reports  the  number  of  tables  that  produced  intervals  in  parentheses.  We 
can,  however,  report  the  median  lengths  for  these  parameter  settings. 

In  constrast  to  the  logistic-normal  model,  the  H02  and  H02SE  log-linear  models 
maintain  close-to-nominal  coverage  for  all  (a,  7)  combinations.  Thus,  these  log-linear 
models  can  describe  both  overall  positive  and  negative  dependence  structures  among 
the  t  samples.  Like  the  case  when  the  underlying  model  is  logistic-normal,  the  H02SE 
model  maintains  coverage  close  to  nominal  level  in  the  one  case  when  H02's  simulated 
coverage  dips  below  .90  (a  —  0.0,  7  =  —1.0,  /3  =  -1).  This  ability  to  model  both 
positive  and  negative  dependence  structures  results  from  the  alternative  motivation 
of  the  models  in  Section  4.1.2  arising  from  a  symmetric  dependence  structure  among 
the  t  samples.  Thus,  another  advantage  of  the  simpler  log-linear  models  over  the 
mixed  models  is  their  ability  to  accurately  estimate  N  for  a  wider  range  of  settings, 
in  particular  the  cases  in  which  a  negative  dependence  structure  exists  among  the  t 
samples.  For  the  most  part,  the  H02  model  is  slightly  more  apt  to  underestimate  N, 
the  mixed  serial  dependence  is  slightly  more  apt  to  overestimate  N,  and  the  logistic- 
normal  and  H02SE  models  overestimate  N  when  overall  negative  dependencies  exist 
and  underestimate  N  when  overall  positive  dependencies  exist. 
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The  performance  of  the  serial  dependence  model  that  ignores  population  het- 
erogeneity when  model  (4.1)  holds  is  analogous  to  the  performance  of  the  mutual 
independence  model  when  the  logistic-normal  model  holds.  This  serial  dependence 
produces  coverage  probabilities  that  are  close  to  the  nominal  level  when  a  =  0.0,  but 
clearly  underestimates  the  population  size  when  population  heterogeneity  is  present. 
As  expected,  the  intervals  produced  by  the  mutual  independence  model  when  model 
(4.1)  holds  rarely  contain  the  true  population  size  since  it  doesn't  allow  for  any  de- 
pendencies, positive  or  negative,  among  the  t  samples.  The  simulated  coverages  from 
this  model  are  respectable  only  when  negative  within-subject  dependence  cancels  with 
positive  dependencies  produced  by  population  heterogeneity  to  produce  overall  weak 
dependencies  among  the  t  samples  (see  (a  —  1.0,  7  =  —0.5)  in  Tables  5.18  and  5.20). 

The  mixed  serial  dependence  model  (4.6)  greatly  improves  upon  the  poor  coverage 
figures  of  the  logistic-normal  model  with  the  addition  of  the  serial  dependence  param- 
eter 7.  Like  the  comparison  between  H02  and  the  logistic-normal  model  when  the 
local  independence  model  is  the  true  underlying  model,  the  H02SE  model  is  always 
competitive  with  the  mixed  serial  dependence  model  in  terms  of  coverage,  while  yield- 
ing much  narrower  confidence  intervals  in  the  presence  of  strong  positive  associations 
between  occasions.  This  is  again  the  result  of  the  flat  log-likelihood  surfaces  produced 
by  the  mixed  model,  as  we  also  observed  censored  profile  likelihood  intervals  when 
/3  =  -l. 

It  is  interesting  that  for  most  cases  studied,  the  mixed  serial  dependence  intervals 
were  shorter  in  terms  of  median  length  than  the  logistic-normal  intervals.  The  cases 
in  which  strong  positive  within-subject  dependence  exists  are  the  exceptions,  but 
there  is  some  evidence  that  the  logistic-normal  coverage  suffers  in  these  cases.  This  is 
an  interesting  development  since  it  suggests  that  there  might  exist  additional  model 
structure  that  can  alleviate  the  near  nonidentifiability  problems  when  a  random  effect 
is  included  in  the  model  and  both  a  and  N  are  unknown. 
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Table  5.17.  Median  error  and  absolute  error  of  Nc  and  coverage  probabilities  (lower 
and  upper  tails  in  parentheses),  mean  widths  and  median  widths  for  95%  profile  like- 
lihood confidence  intervals  when  t  —  4  sample  capture-recapture  data  are  generated 
from  serial  dependence  model  (4.1)  with  TV  =  320,  a  =  0.0  and  (3  =  0 


Assumed 

Mean 

Median 

Median 

Median 

7           Model 

Coverage 

Width 

Width 

Err. 

Abs.  Err. 

-1.0          LNIO 

.000  (1.00,  .000) 

26.6 

26.5 

25.5 

25.5 

H02 

.923  (.020,  .057) 

7.1 

6.9 

-0.7 

1.4 

SE 

.937  (.040,  .023) 

7.6 

7.5 

0.1 

1.3 

H02SE 

.934  (.041,  .025) 

9.2 

8.8 

0.2 

1.4 

MIXED  SE 

.933  (.054,  .013) 

9.4 

8.8 

0.6 

1.4 

IND 

.000  (1.00,  .000) 

26.6 

26.5 

25.5 

25.5 

-0.5          LN10 

.058(.942,  .000) 

24.8 

24.7 

17.1 

17.0 

H02 

.952  (.029,  .019) 

16.7 

16.2 

-0.4 

2.6 

SE 

.956  (.024,  .020) 

14.2 

13.9 

0.2 

2.5 

H02SE 

.949  (.038,  .013) 

18.1 

17.2 

0.2 

2.7 

MIXED  SE 

.949  (.044,  .007) 

18.0 

16.9 

1.2 

2.7 

IND 

.058  (.942,  .000) 

24.8 

24.7 

17.0 

17.0 

0.5          LN10 

.946  (.023,  .031) 

63.2 

58.4 

-0.9 

9.7 

H02 

.947  (.022,  .031) 

58.1 

56.3 

-1.7 

9.5 

SE 

.946  (.031,  .023) 

45.1 

44.3 

0.3 

7.2 

H02SE 

.940  (.032,  .028) 

61.2 

59.3 

0.3 

9.8 

MIXED  SE 

.936  (.053,  .011) 

60.2 

56.5 

3.9 

8.6 

IND 

.006  (.000,  .994) 

16.2 

16.1 

-25.9 

25.9 

1.0          LN10 

.930  (.032,  .038) 

154.8 

169.7 

-7.3 

17.0 

H02 

.948  (.011,  .041) 

89.6 

85.7 

-6.6 

15.2 

SE 

.952  (.023,  .025) 

80.1 

76.8 

-0.2 

11.6 

H02SE 

.956  (.023,  .021) 

110.0 

104.0 

0.6 

16.4 

MIXED  SE 

.959  (.034,  .007) 

111.2 

101.3 

6.6 

14.4 

IND 

.000  (.000,  1.00) 

10.8 

10.8 

-56.2 

56.2 
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Table  5.18.  Median  error  and  absolute  error  of  Nc  and  coverage  probabilities  (lower 
and  upper  tails  in  parentheses),  mean  widths  and  median  widths  for  95%  profile  like- 
lihood confidence  intervals  when  t  =  4  sample  capture-recapture  data  are  generated 
from  serial  dependence  model  (4.1)  with  N  =  320,  a  =  1.0  and  (3  =  0 


Assumed 

Mean 

Median 

Median 

Median 

7          Model 

Coverage 

Width 

Width 

Err. 

Abs.  Err. 

-1.0         LNIO 

.131 

(.868,  .001) 

23.9 

24.2 

15.0 

15.1 

H02 

.935 

(.013,  .052) 

16.8 

16.4 

-1.8 

3.2 

SE 

.473 

(.000,  .527) 

8.9 

8.9 

-5.6 

5.6 

H02SE 

.948 

(.035,  .017) 

20.8 

20.1 

0.3 

3.2 

MIXED  SE 

.949 

(.035,  .016) 

20.8 

20.2 

0.3 

3.2 

IND 

.132 

(.868,  .000) 

24.3 

24.2 

15.0 

15.1 

-0.5          LNIO 

.952 

(.032,  .016) 

35.6 

34.3 

0.7 

5.1 

H02 

.939 

(.028,  .033) 

36.5 

35.3 

-0.1 

5.8 

SE 

.274 

(.000,  .726) 

15.4 

15.1 

-12.5 

12.5 

H02SE 

.937( 

.037,  .026) 

38.6 

37.6 

0.7 

6.1 

MIXED  SE 

.938 

(.037,  .025) 

40.0 

38.5 

0.8 

6.2 

IND 

.884 

(.007,  .019) 

20.5 

20.3 

-3.5 

4.4 

0.5          LN10 

.946 

(.021,  .033) 

173.6 

187.5 

-4.0 

19.6 

H02 

.947 

(.020,  .033) 

102.4 

98.5 

-3.6 

15.7 

SE 

.253 

(.000,  .747) 

42.0 

40.7 

-35.1 

35.1 

H02SE 

.944 

(.024,  .032) 

108.7 

103.9 

-1.0 

16.1 

MIXED  SE 

.944 

(.026,  .036) 

145.8 

139.7 

-0.7 

16.9 

IND 

.000 

(.000,  1.00) 

9.9 

9.8 

-61.3 

61.3 

1.0          LN10 

.795 

(.021,  .203) 

131.7 

131.4 

-31.3 

35.7 

H02 

.937 

(.009,  .054) 

149.9 

142.7 

-9.2 

24.0 

SE 

.480 

(.000,  .520) 

72.3 

67.6 

-45.2 

45.2 

H02SE 

.954 

(.016,  .030) 

186.9 

170.2 

-1.7 

24.8 

MIXED  SE 

.944 

(.020,  .036) 

241.6 

252.7 

-0.9 

28.5 

IND 

.000 

(.000,  1.00) 

5.6 

5.6 

-89.3 

89.4 
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Table  5.19.  Median  error  and  absolute  error  of  Nc  and  coverage  probabilities  (lower 
and  upper  tails  in  parentheses),  mean  widths  and  median  widths  for  95%  profile  like- 
lihood confidence  intervals  when  t  =  4  sample  capture-recapture  data  are  generated 
from  serial  dependence  model  (4.1)  with  N  =  320,  a  =  0.0  and  (3  =  —  1 


Assumed 

Mean 

Median 

Median 

Median 

7 

Model 

Coverage 

Width 

Width 

Err. 

Abs.  Err. 

-1.0 

LN10 

.000 

;i.oo 

.000 

)       59.3 

58.9 

65.5 

65.5 

H02 

.853 

;.oo3 

.144 

)       26.0 

24.4 

-6.6 

7.0 

SE 

.953 

;.026 

.021 

)       22.8 

22.5 

0.0 

3.9 

H02SE 

.952 

;.022 

.026 

)      39.2 

36.3 

-0.3 

5.6 

MIXED  SE 

.951 

;.043 

.005, 

)        —  (993) 

33.8 

2.1 

4.7 

IND 

.000 

;i.oo 

.000, 

)       59.3 

58.9 

65.5 

65.5 

-0.5 

LN10 

.036 

;.964 

.000, 

)       76.6 

73.5 

49.6 

49.6 

H02 

.948 

[.011 

.041^ 

)       78.1 

74.7 

-4.4 

12.9 

SE 

.951 

;.02i 

.028^ 

)       46.2 

45.6 

0.1 

7.8 

H02SE 

.964 

[.017 

.019] 

)      88.3 

83.4 

0.6 

12.1 

MIXED  SE 

.958 

;.038 

.004; 

1        —  (976) 

77.4 

6.1 

10.1 

IND 

.035 

;.964 

.001^ 

)       67.7 

67.5 

49.5 

49.5 

0.5 

LN10 

.938 

;.027 

.035; 

1          -  (974) 

404.0 

-11.4 

53.7 

H02 

.926 

;.02i 

.053^ 

I     288.8 

261.0 

-15.4 

46.5 

SE 

.947 

;.024 

.029; 

1     194.6 

176.7 

-2.9 

29.6 

H02SE 

.935 

;.032 

.033; 

328.1 

294.1 

-2.1 

47.2 

MIXED  SE 

.944  | 

;.049 

.007; 

1        —  (988) 

301.9 

17.8 

37.2 

IND 

.048  | 

;.ooo 

.952; 

63.3 

62.4 

-78.1 

78.1 

1.0 

LN10 

.933  ( 

.035. 

.032; 

" (814) 

820.5 

-17.5 

101.2 

H02 

.9181 

.005. 

.077; 

403.6 

346.9 

-53.3 

76.2 

SE 

.937  ( 

[.032, 

.031; 

489.0 

364.4 

-3.2 

54.1 

H02SE 

.961  ( 

.014, 

.024; 

635.2 

533.8 

-2.3 

71.9 

MIXED  SE 

.948  ( 

.046, 

.006; 

— (935) 

601.8 

31.7 

66.8 

IND 

.000  ( 

.000, 

1.00; 

49.2 

48.1 

-157.5 

157.5 

131 


Table  5.20.  Median  error  and  absolute  error  of  Nc  and  coverage  probabilities  (lower 
and  upper  tails  in  parentheses),  mean  widths  and  median  widths  for  95%  profile  like- 
lihood confidence  intervals  when  t  =  4  sample  capture-recapture  data  are  generated 
from  serial  dependence  model  (4.1)  with  N  =  320,  a  —  1.0  and  (3  —  —  1 


Assumed 
7  Model 


Coverage 


Mean  Median      Median       Median 

Width  Width         Err.        Abs.  Err. 


-1.0          LNIO 

.155 

;.844 

.ooo; 

48.8 

47.7 

29.1 

29.1 

H02 

.854 

;.oo2 

.144; 

42.0 

40.6 

-9.4 

10.7 

SE 

.204 

;.ooo 

.796; 

20.1 

19.9 

-17.9 

17.9 

H02SE 

.958 

;.023 

.019; 

60.4 

56.9 

0.4 

8.6 

MIXED  SE 

.957 

;.024 

.019; 

64.6 

59.1 

0.6 

8.8 

IND 

.154 

;.864 

.000; 

1       47.1 

46.9 

29.1 

29.1 

-0.5         LN10 

.975 

;.oi2 

.013; 

91.7 

84.5 

-2.5 

12.2 

H02 

.942 

j.on 

.047; 

93.6 

90.3 

-5.7 

16.1 

SE 

.116 

;.ooo 

.884; 

33.8 

33.4 

-34.5 

34.5 

H02SE 

.949 

;.023 

.028; 

102.8 

98.7 

-0.7 

15.7 

MIXED  SE 

.950 

|.027 

.023; 

129.0 

115.4 

0.9 

16.5 

IND 

.829 

;.ooo 

.171] 

43.2 

42.8 

-10.9 

11.8 

0.5          LN10 

.940 

;.045 

.015; 

—  (666) 

831.9 

10.0 

44.9 

H02 

.936 

;.oio 

.054; 

224.9 

207.6 

-19.8 

39.2 

SE 

.300 

;.ooo 

.700; 

92.5 

86.2 

-75.6 

75.6 

H02SE 

.944 

;.oi7 

.039; 

247.7 

225.3 

-12.4 

39.8 

MIXED  SE 

.950 

;.029 

.021; 

—  (873) 

711.5 

-1.7 

44.0 

IND 

.000 

;.ooo 

1.00; 

22.5 

22.3 

-125. 

125.5 

1.0          LN10 

.924 

;.020 

.056; 

-  (943) 

267.4 

-15.8 

42.0 

H02 

.914 

;.oo6 

.080; 

297.5 

266.2 

-41.7 

58.7 

SE 

.532 

;.ooo 

.468; 

171.9 

144.2 

-92.9 

93.0 

H02SE 

.948 

;.022 

.030; 

425.7 

356.7 

-15.2 

58.3 

MIXED  SE 

.950 

;.03i 

.019; 

—  (722) 

1216.1 

0.5 

67.5 

IND 

.000  1 

;.ooo 

1.00; 

13.3 

13.0 

-172.1 

172.1 
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Although  the  profile  likelihood  differences  between  models  are  similar  to  those 
displayed  by  the  bootstrap,  the  actual  coverage  for  these  profile  likelihood  intervals 
are  much  closer  to  the  nominal  level.  Since  the  value  of  B  has  little  effect  on  coverage 
properties,  this  deficiency  of  the  bootstrap  is  most  likely  due  to  the  particular  ap- 
plication of  capture-recapture.  Thus,  the  profile  likelihood  intervals  are  preferable  to 
the  bootstrap  in  terms  of  simultaneous  good  coverage  and  computational  complexity. 
Also,  in  using  the  profile  likelihood  confidence  intervals,  one  is  aware  of  the  existence 
of  a  flat  log-likelihood  often  associated  with  mixed  models  (3.6),  (3.20),  and  (4.6). 
Thus,  we  advocate  the  use  of  the  profile  likelihood  intervals  over  the  bootstrap  in- 
tervals when  computing  interval  estimates  for  N.  This  recommendation  is  consistent 
with  that  given  by  Evans  et  al.  (1996)  for  the  simple  two-sample  case. 

5.3.2     PLC  and  Flat  Likelihoods 

Section  3.5  discusses  the  flat  log-likelihoods  associated  with  the  latent  class  model 
when  t  =  3.  In  this  section,  we  present  simulations  that  demonstrate  the  close 
similarity  between  quasi-symmetry  model  (3.2)  and  the  QLC  model  when  t  =  3,  and 
also  demonstrate  that  these  flat  profile  likelihoods  can  occur  when  t  >  3. 

The  first  latent  class  profile  likelihood  study  simulated  1000  2'  tables  generated 
from  the  logistic-normal  model  for  each  combination  of  t  =  (3,4,5),  N  =  (bt,20t), 
a  =  (0.0, 0.5, 1.0),  and  (3  =  0.  The  purpose  of  this  study  was  to  investigate  the  impact 
of  Lindsay  et  al.'s  (1991)  results  that  link  the  quasi-symmetry  model  to  the  latent 
class  model  on  capture- recapture  (see  Section  3.5).  For  t  =  3,  every  generated  table 
for  every  combination  of  (N,  a)  produced  an  infinite  95%  latent  class  profile  likelihood 
confidence  interval  with  lower  bound  only.  The  average  differences  between  n  low  eh 
and  n  were  all  less  than  one  when  N  =  40  and  all  less  than  11  when  N  =  160, 
reflecting  the  similarity  between  the  latent  class  interval  and  the  quasi-symmetry 
interval  of  (n,  oo). 
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For  t  >  3,  the  latent  class  profile  likelihood  interval  need  not  have  infinite  width. 
Table  5.21  presents  results  for  t  =  4  and  t  =  5.  Each  (N,  a)  combination  is  divided 
into  two  rows.  The  top  row  corresponds  to  finite  intervals,  with  the  number  in 
parantheses  next  to  coverage  indicating  how  many  tables  out  of  1000  yielded  a  finite 
interval.  The  bottom  row  corresponds  to  the  infinite  intervals.  Hence  no  width  figures 
are  reported  for  these  tables. 


Table  5.21.  Mean  and  median  absolute  error  of  Nc  and  coverage  probabilities,  mean 
widths,  and  median  widths  for  95%  profile  likelihood  confidence  intervals  from  the 
QLC  model  when  ^-sample  capture-recapture  data  are  generated  from  the  logistic- 
normal  model  with  (3  =  0 

Overall  Mean     Median  Mean  Median 

t      N       a      Coverage     Coverage         Width     Width         Abs.  Err.     Abs.  Err. 


4   80 

0.0 

.949 

.750  (16) 

.952 

25.9 

16.5 

3.8 
2923.3 

3.6 
2.6 

0.5 

.973 

.975  (40) 
.973 

24.8 

14.1 

3.2 
3972.9 

2.7 
4.2 

1.0 

.977 

.898  (128) 
.988 

36.1 

20.8 

4.8 
4230.4 

4.0 
6.8 

320 

0.0 

.968 

.944  (18) 
.969 

40.6 

28.0 

4.1 
136.8 

2.9 

4.1 

0.5 

.967 

.934  (91) 

.970 

76.4 

36.7 

6.9 
6619.4 

6.2 
11.4 

1.0 

.915 

.833  (456) 
.983 

102.2 

58.1 

16.7 
3571.8 

17.0 
15.9 

5  160 

0.0 

..950 

.971  (35) 
.954 

30.3 

11.7 

2.2 
1758.6 

2.2 

2.1 

0.5 

.970 

.940  (149) 
.975 

34.0 

16.4 

3.3 
2832.5 

2.9 
4.6 

1.0 

.894 

.852  (665) 
.979 

45.3 

24.1 

6.7 
707.1 

6.3 
6.6 

640 

0.0 

.951 

.897  (29) 
.953 

36.2 

22.5 

5.1 
2608.5 

4.8 
4.3 

0.5 

.956 

.940  (470) 
.970 

92.6 

46.2 

7.8 
3760.4 

6.7 
10.3 

1.0 

.701 

.700  (998) 
1.00 

60.3 

49.0 

21.3 
54.6 

21.4 
54.6 

Table  5.21  shows  that  the  number  of  tables  yielding  finite  intervals  increases  as 
a  increases  for  fixed  N,  and  also  as  N  increases  for  fixed  a.   We  also  see  the  main 
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implication  of  a  flat  profile  likelihood.  The  mean  absolute  error  between  Nc  obtained 
from  the  flat  likelihood  tables  is  enormous  compared  to  the  error  corresponding  to 
finite  interval  tables.  This  reflects  the  fact  that  the  point  estimates  are  essentially 
arbitrary  in  the  presence  of  a  flat  profile  likelihood.  We  also  see  that  the  mean  absolute 
error  for  Nc  from  infinite-interval  tables  is  large  relative  to  the  median  absolute  error, 
indicating  large  skew  with  respect  to  width. 

This  study  also  suggests  that  for  moderate  to  large  a,  the  finite  intervals  from 
the  latent  class  model  are  overly  optimistic  in  that  the  actual  coverage  is  less  than 
the  nominal  level.  Thus,  we  are  skeptical  of  the  narrow  latent  class  profile  likelihood 
confidence  interval  for  the  snowshoe  hare  data,  for  which  the  logistic-normal  model 
suggests  moderate  heterogeneity  with  a  =  .9.  For  small  a,  this  cannot  be  said 
definitively  because  of  the  small  number  of  tables  yielding  finite  intervals. 

We  also  investigated  the  performance  of  the  latent  class  model  for  t  =  4  using  the 
factorial  structure  used  for  Tables  5.9-5.20.  Tables  5.22-  5.26  present  the  results.  We 
see  that  these  flat  profile  likelihoods  are  not  a  result  of  incorrectly  assuming  the  latent 
class  model  holds  when  the  logistic-normal  model  truly  holds  since  we  also  see  the 
flat  profile  likelihoods  when  the  latent  class  model  is  the  true  underlying  model.  The 
most  striking  result  is  the  horrible  perfomance  of  this  model  when  (a  =  l,/9  =  —1) 
for  all  underlying  models.  The  profile  likelihood  interval  never  contains  the  true  N 
when  there  is  severe  heterogeneity  and  small  probabilities  of  capture  at  each  of  the  t 
occasions. 

The  results  on  the  performance  of  the  latent  class  model  when  other  models  hold 
agree  with  the  previous  latent  class  study.  The  number  of  tables  producing  finite 
intervals  increases  as  population  heterogeneity  increases,  for  fixed  N,  and  as  N  in- 
creases, for  a  fixed  amount  of  population  heterogeneity.  The  finite  intervals  here  also 
display  slightly  lower-than-nominal  coverage,  and  the  mean  absolute  errors  of  Nc  are 
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large  for  tables  for  which  the  latent  class  assumption  yields  infinite  profile  likelihood 
intervals. 


Table  5.22.  Mean  and  median  absolute  error  of  Nc  and  coverage  probabilities,  mean 
width,  and  median  width  for  95%  profile  likelihood  confidence  intervals  from  the  QLC 
model  when  t  =  4  sample  capture-recapture  data  are  generated  from  the  logistic- 
normal  model  with  /3  =  —  1 

Overall  Mean     Median  Mean  Median 

N       a      Coverage     Coverage         Width     Width         Abs.  Err.     Abs.  Err. 


80   0.0 

.967 

1.00  (8) 
.967 

58.2 

53.0 

12.2 
353.2 

10.6 
6.5 

0.5 

.989 

1.00  (16) 
.989 

45.4 

43.8 

4.8 
1573.2 

4.8 
8.5 

1.0 

.991 

.921  (76) 
.998 

64.3 

37.7 

10.2 
4401.8 

10.2 
15.9 

320  0.0 

.954 

.875  (16) 
.956 

151.2 

88.4 

21.2 
1681.0 

15.1 
15.9 

0.5 

.996 

.933  (30) 
.998 

137.9 

87.6 

16.7 
6129.6 

13.6 
29.7 

1.0 

.000 

.000  (827) 
.000 

194.0 

136.4 

262.4 
1416.3 

259.8 
378.9 

Table  5.23.  Mean  and  median  absolute  error  of  Nc  and  coverage  probabilities,  mean 
width,  and  median  width  for  95%  profile  likelihood  confidence  intervals  from  the  QLC 
model  when  t  =  4  sample  capture-recapture  data  are  generated  from  the  QLC  model 
with  v  =  (.5,  .5)  and  (3  =  0 

Overall  Mean     Median  Mean  Median 

N       a      Coverage     Coverage         Width     Width         Abs.  Err.     Abs.  Err. 


80  0.5 

.957 

.900  (20) 
.958 

17.6 

11.1 

2.1 
1960.5 

1.5 
1.9 

1.0 

.950 

.961  (51) 

.949 

18.5 

10.5 

1.5 
2268.5 

1.0 
2.1 

320  0.0 

.957 

.824  (34) 
.962 

26.6 

16.5 

4.3 
2739.7 

3.6 
4.0 

0.5 

.965 

.921  (164) 
.974 

45.5 

19.7 

3.5 

1741.8 

3.0 

4.8 
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Table  5.24.  Mean  and  median  absolute  error  of  Nc  and  coverage  probabilities,  mean 
width,  and  median  width  for  95%  profile  likelihood  confidence  intervals  from  the  QLC 
model  when  t  —  4  sample  capture-recapture  data  are  generated  from  the  QLC  model 
with  v  —  (.5,  .5)  and  (3  =  —  1 

Overall  Mean     Median  Mean  Median 

N       a      Coverage     Coverage         Width     Width         Abs.  Err.     Abs.  Err. 


80  0.5 

.968 

.900  (10) 
.969 

94.8 

42.9 

7.2 
1301.0 

6.9 
6.0 

1.0 

.984 

1.00  (18) 
.984 

41.3 

29.2 

4.9 
4118.4 

5.1 
6.8 

320  0.5 

.976 

.929  (14) 
.977 

103.0 

75.5 

12.9 
5265.1 

11.7 
14.1 

1.0 

.000 

.000  (213) 
.000 

160.5 

102.1 

310.9 
7099.4 

309.1 
332.1 

Table  5.25.  Mean  and  median  absolute  error  of  Nc  and  coverage  probabilities,  mean 
width,  and  median  width  for  95%  profile  likelihood  confidence  intervals  from  the  QLC 
model  when  t  =  4  sample  capture-recapture  data  are  generated  from  the  QLC  model 
when  t  =  4  sample  capture-recapture  data  are  generated  by  the  QLC  model  with 
v  =  (.75,  .25)  and  (3  =  0 

Overall  Mean     Median  Mean  Median 

N       a      Coverage     Coverage         Width     Width         Abs.  Err.     Abs.  Err. 


80  0.5 

.963 

.938  (16) 
.963 

40.0 

12.5 

2.3 
2594.3 

2.2 
2.3 

1.0 

.964 

.980  (50) 
.963 

27.2 

12.5 

2.0 
2087.6 

1.8 
2.4 

320  0.5 

.958 

.903  (31) 
.960 

23.3 

21.8 

4.4 
2812.7 

3.4 
4.6 

1.0 

.973 

.957(117) 
.975 

44.4 

26.3 

4.2 
2873.2 

4.0 

5.8 
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Table  5.26.  Mean  and  median  absolute  error  of  Nc  and  coverage  probabilities,  mean 
width,  and  median  width  for  95%  profile  likelihood  confidence  intervals  from  the  QLC 
model  when  t  =  4  sample  capture-recapture  data  are  generated  from  the  QLC  model 
with  v  =  (.75,  .25)  and  0  =  -1 

Overall  Mean     Median  Mean  Median 

N       a      Coverage     Coverage         Width     Width         Abs.  Err.     Abs.  Err. 


80   0.5 

.969 

.800  (15) 
.972 

52.1 

49.5 

11.3 

1173.3 

9.5 
6.5 

1.0 

.979 

.918  (34) 
.982 

71.9 

44.0 

6.8 
2756.3 

4.6 

7.4 

320  0.5 

.979 

.923  (13) 
.980 

89.1 

65.7 

15.6 
3759.3 

12.1 
15.9 

1.0 

.000 

.000  (238) 
.000 

159.3 

94.4 

313.0 
6268.3 

310.9 
332.4 

Table  5.27.  Mean  and  median  absolute  error  of  Nc  and  coverage  probabilities,  mean 
width,  and  median  width  for  95%  profile  likelihood  confidence  intervals  from  the  QLC 
model  when  t  =  A  sample  capture-recapture  data  are  generated  from  the  log-linear 
model  of  homogeneous  two-factor  interaction  with  (3  =  0 

Overall  Mean     Median  Mean  Median 

N        a       Coverage     Coverage         Width     Width         Abs.  Err.     Abs.  Err. 


80   0.25 

.975 

1.00  (48) 
.974 

19.3 

9.3 

1.6 
672.1 

1.3 
2.0 

0.50 

.988 

.977  (131) 
.989 

13.0 

6.4 

1.1 
921.8 

0.9 

1.5 

320  0.25 

.977 

.944  (142) 
.984 

51.3 

24.4 

4.1 
84.0 

3.6 
5.5 

0.50 

.959 

.942  (499) 
.977 

35.1 

15.5 

3.0 
68.0 

2.7 

4.0 

Table  5.28.  Mean  and  median  absolute  error  of  Nc  and  coverage  probabilities,  mean 
width,  and  median  width  for  95%  profile  likelihood  confidence  intervals  from  the  QLC 
model  when  t  =  4  sample  capture-recapture  data  are  generated  from  the  log-linear 
model  of  homogeneous  two-factor  interaction  with  (3  —  —  1 

Overall  Mean     Median  Mean  Median 

N        a       Coverage     Coverage         Width     Width         Abs.  Err.     Abs.  Err. 


80   0.25 

.989 

.929  (28) 
.992 

52.7 

34.8 

7.0 
15.4 

6.2 
6.8 

0.50 

.978 

.844  (90) 
.997 

46.2 

23.5 

6.8 
18.9 

5.3 
7.6 

320  0.25 

.996 

.977  (43) 
.997 

122.4 

80.0 

16.0 
49.1 

15.7 
20.3 

0.50 

.946 

.817  (262) 
.997 

143.2 

77.0 

24.6 
53.3 

25.3 
21.5 
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Table  5.29.  Mean  and  median  absolute  error  of  Nc  and  coverage  probabilities,  mean 
width,  and  median  width  for  95%  profile  likelihood  confidence  intervals  from  the 
QLC  model  when  t  =  4  sample  capture-recapture  data  are  generated  from  the  serial 
dependence  model  (4.1)  with  (3  =  0 

Overall  Mean     Median  Mean  Median 

N       a      Coverage      Coverage  Width     Width         Abs.  Err.     Abs.  Err. 


0.0     -1.0 

.000 

.000 

(1000) 

26.6 

26.5 

25.6 

25.5 

-0.5 

.058 

.043 
.078 

(577) 

24.9 

24.8 

17.3 
16.8 

17.2 

16.8 

0.5 

.914 

.782 
.997 

(385) 

72.0 

43.5 

15.0 

2454.4 

14.9 
14.2 

1.0 

.424 

.389 
1.00 

(942) 

61.3 

44.1 

37.3 
23.6 

38.3 
26.1 

1.0    -1.0 

.132 

.095 
.171 

(516) 

24.6 

24.5 

15.6 
14.4 

15.5 

14.4 

-0.5 

.974 

.907 
.977 

(43) 

49.7 

27.4 

6.5 
3202.5 

6.0 
6.3 

0.5 

.563 

.517 
1.00 

(903) 

84.9 

55.9 

37.3 

23.1 

38.0 
19.1 

1.0 

.108 

.104 
1.00 

(994) 

51.9 

42.7 

67.3 
39.8 

68.1 
47.6 

5.4     Narrow  Intervals  vs.  Attained  Nominal  Confidence 


In  capture- recapture  experiments,  both  point  estimates  N  and  Nc  ar>d  the  asso- 
ciated confidence  intervals  depend  strongly  on  the  choice  of  model.  In  typical  exper- 
iments, the  probability  of  capture  is  small  and  most  subjects  appear  in  relatively  few 
samples.  There  then  typically  exists  an  increasing  ordering  of  the  magnitude  of  N 
from  simple  to  more  complex  models.  The  width  of  the  interval  estimates  also  follow 
this  ordering,  reflecting  the  smaller  standard  errors  obtained  with  more  parsimonious 
models.  The  simpler  models  also  have  the  advantage  of  greater  stability,  with  the 
TV-estimates  not  fluctuating  so  wildly  with  small  changes  in  the  data.  We  get  nothing 
for  free,  however.  These  simpler  models  either  do  not  account  for  the  population  het- 
erogeneity or  underestimate  it,  so  that  the  point  estimates  can  severly  underestimate 


139 


Table  5.30.  Mean  and  median  absolute  error  of  Nc  and  coverage  probabilities,  mean 
width,  and  median  width  for  95%  profile  likelihood  confidence  intervals  from  the 
QLC  model  when  t  =  4  sample  capture-recapture  data  are  generated  from  serial 
dependence  model  (4.1)  with  $  —  —  1 

Overall  Mean     Median  Mean  Median 

N       a      Coverage     Coverage         Width     Width         Abs.  Err.     Abs.  Err. 


0.0    -1.0 

.000 

.000  (879) 
.000 

59.1 

58.8 

65.8 
67.7 

65.5 
65.7 

-0.5 

.036 

.070  (43) 
.034 

67.6 

67.8 

49.3 
52.0 

49.2 
49.6 

0.5 

.965 

.592  (71) 
1.00 

150.7 

104.2 

58.4 
2538.7 

59.5 
63.5 

1.0 

.823 

.223  (202) 
1.00 

133.0 

103.5 

133.9 

825.2 

136.0 
124.2 

1.0    -1.0 

.154 

.115  (244) 
.167 

46.8 

46.7 

29.6 
29.3 

29.6 
28.9 

-0.5 

.992 

.957  (984) 
.993 

74.7 

51.2 

9.2 
5267.2 

6.1 

14.4 

0.5 

.679 

.447  (579) 
1.00 

168.4 

105.9 

90.4 
2062.5 

93.4 
69.7 

1.0 

.278 

.168  (865) 
1.00 

112.7 

78.7 

137.5 
107.6 

139.4 
114.7 
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N.  This  underestimation,  along  with  the  smaller  standard  errors  associated  with 
these  estimates,  lead  to  confidence  intervals  that  have  actual  coverages  well  below  the 
nominal  level. 

These  properties  lead  to  a  trade-off  between  models  that  produce  narrow  con- 
fidence intervals  for  N  (but  often  with  false  confidence),  and  models  that  provide 
wide  confidence  intervals  with  actual  coverage  close  to  the  nominal  level.  Much  of 
the  previous  literature  on  models  that  accommodate  population  heterogeneity  has 
recommended  models  producing  narrow  intervals,  but  we  believe  that  this  sacrifices 
actual  coverage  considerably. 

An  example  of  this  contrast  is  the  difference  between  the  H02  estimate  and  a 
sample  coverage  estimate,  Nsc,  given  by  Chao  and  Tsay  (1996a,b)  for  the  hepititis 
data  set.  There,  Nho2  has  a  standard  error  of  about  900,  causing  the  authors  to 
reject  this  estimator  in  favor  of  Nsc,  which  has  a  much  narrower  confidence  interval. 
Chao  and  Tsay's  simulations,  however,  indicate  that  when  the  capture  history  counts 
are  simulated  from  the  logistic-normal  model  with  N  —  200,  the  actual  coverage  for 
95%  confidence  intervals  generated  from  Nsc  IS  58.5%,  while  the  corresponding  figure 
for  NH02  is  91.5%. 

This  trade-off  is  evident  in  several  of  the  simulation  studies.  We  see  the  mutual 
independence  model  provides  the  narrowest  intervals  and  the  poorest  coverage.  We 
see  that  the  bootstrap  based  on  N  for  the  latent  class  model  yields  extremely  narrow 
intervals  relative  to  the  logistic-normal  and  H02  models.  We  have  noted  that  these 
intervals  also  have  horrible  coverage,  since  theory  and  the  behavior  of  the  profile 
likelihood  intervals  tells  us  that  these  intervals  are  often  infinite.  As  in  the  case  of 
the  snowshoe  hare  data,  when  the  latent  class  model  yields  a  finite  profile  likelihood 
interval,  these  intervals  are  narrower  than  the  logistic-normal  and  H02  intervals, 
and  the  resulting  coverages  are  less  than  nominal.  Another  example  is  the  serial 
dependence  model.    This  model  also  provides  profile  likelihood  intervals  that  are 
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narrower  than  those  of  H02,  but  Tables  5.9-  5.14  demonstrate  that  this  model's 
coverage  also  degrades  for  the  logistic-normal  model  with  a  >  .5. 

With  this  trade-off  in  mind,  the  H02  and  H02SE  log-linear  models  are  appealing 
alternatives  to  the  their  mixed  counterparts  when  a  mixed  model  holds  with  large 
heterogeneity,  small  probability  of  capture,  or  both.  These  are  cases  that  produce 
2*  tables  with  most  of  the  observed  subjects  recorded  on  only  one  or  two  sampling 
occasions.  In  these  situations,  H02  and  H02SE  yield  much  more  informative  intervals 
than  the  true  model.  Unlike  other  models  that  yield  narrow  intervals,  however,  these 
models  maintain  coverage  that  is  close  to  the  nominal  level.  Thus,  we  consider  the 
H02  and  H02SE  models  a  good  compromise  with  respect  to  this  trade-off. 

5.5    Recommendations 

The  simulations  from  this  chapter  provide  insight  on  which  models  are  informative 
for  different  data  configurations.  Since  this  problem  is  one  of  extrapolation,  there  is 
always  the  danger  that  the  true  unobserved  cell  count  differs  markedly  from  the 
pattern  observed  in  the  incomplete  table.  The  extrapolation  issue  aside,  this  chapter 
has  demonstrated  that  even  if  the  complete  table  follows  a  continuous  mixture  model, 
in  certain  situations  (namely  large  amounts  of  heterogeneity,  small  probability  of 
capture,  and  negative  dependence  structure),  one  can  do  better  by  considering  simpler 
log-linear  models  that  account  for  the  population  heterogeneity  by  adding  only  one 
or  two  association  parameters  to  the  log-linear  model  of  mutual  independence.  We 
have  seen  that  the  confidence  intervals  in  these  situations  are  much  narrower  than 
those  for  the  LN  model,  without  losing  much  in  the  way  of  coverage.  The  estimate 
often  provides  intervals  that  are  wide,  giving  little  information  on  TV,  which  is  often 
a  source  of  criticism  in  the  literature.  Nonetheless,  we  feel  that  these  wide  intervals 
reflect  the  small  amount  of  information  about  the  population  size  that  results  from 
most  subjects  being  captured  on  only  one  occasion.    We  believe  that  models  that 
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provide  narrower  intervals  are  overly  optimistic,  with  coverage  probabilities  being 
substantially  less  than  advertised. 

As  a  result,  we  recommend  that  the  logistic- normal  model  and  the  mixed  serial 
dependence  model  be  used  as  diagnostic  tools.  The  MLE  of  a  and  the  profile  likeli- 
hood from  these  models,  along  with  the  numbers  of  subjects  captured  0, . . . ,  t  times, 
provide  an  idea  of  the  amount  of  heterogeneity  present  and  the  probabilities  of  cap- 
ture for  a  given  table.  If  0  <  a  <  1  and  the  occasion  parameter  estimates  are  not 
large  negative  numbers,  we  recommend  using  the  profile  likelihood  interval  based  on 
Nc  from  this  model.  Tables  5.11-5.14  suggest  that  even  if  this  model  is  not  the  true 
model,  it  performs  well  as  long  as  most  subjects  are  not  recorded  only  once  or  twice. 
Also,  simulations  show  that  when  the  subjects  are  spread  somewhat  evenly  over  num- 
bers 0, . . . ,  t  of  captures,  this  model  does  slightly  better  than  the  H02  model  with 
respect  to  coverage,  justifying  the  extra  computational  effort  of  employing  the  nu- 
merical integration  approximation  of  the  marginal  log-likelihood.  This  approximation 
need  not  be  performed  in  a  low-level  computer  language.  There  exist  general  GLIM 
macros  (Aitkin  1996)  that  conduct  marginal  maximum  likelihood  analyses  of  gener- 
alized linear  mixed  models.  One  can  obtain  Nc  for  this  model  using  these  macros, 
although  the  search  for  the  profile  likelihood  interval  endpoints  can  be  conducted 
much  faster  with  FORTRAN.  If  the  logistic-normal  model  yields  a  =  0.0,  one  should 
consider  the  possibility  of  negative  dependencies  between  the  t  occasions,  in  which 
cases  one  of  the  iog-linear  models  of  the  above  paragraph  or  the  mixed  serial  depen- 
dence model,  provided  it  doesn't  produce  a  flat  log-likelihood,  should  be  considered 
since  the  logistic-normal  model  cannot  not  accurately  estimate  N. 

When  most  subjects  are  captured  on  only  a  few  number  of  occasions  and  the 
continuous  mixture  model  yields  a  flat  likelihood,  however,  the  remarks  of  the  previous 
section  hold  and  we  recommend  using  the  simpler  H02  and  H02SE  log-linear  models. 
A  conservative  approach  would  use  the  latter  model,  since  the  simulation  studies 
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suggest  that  it  maintains  coverage  close  to  nominal  level  in  those  few  cases  when  the 
actual  coverage  of  H02  dips  below  .90.  For  all  underlying  models  and  parameter 
settings  considered,  this  model  yielded  coverage  that  was  never  far  from  the  nominal 
level.  If  the  somewhat  wide  intervals  from  these  models  are  unsatisfactory,  one  can 
take  a  liberal  approach  by  using  the  overdispersed  Poisson  model  of  Section  4.2, 
which  widens  the  naive  mutual  independence  interval  in  these  cases  but  still  provides 
a  narrow  interval,  with  the  understanding  that  the  chances  of  the  true  population 
size  being  in  the  resulting  confidence  interval  could  be  less  than  anticipated. 

Severe  population  heterogeneity  in  a  capture-recapture  experiment  makes  reaching 
useful  conclusions  on  N  difficult.  When  this  is  the  case,  one  must  use  caution  in 
estimating  N  with  overly  simple  capture-recapture  models,  since  these  models  tend 
to  produce  optimistic  confidence  statements  about  N,  while  the  mixed  logistic  models 
of  Chapters  3  and   4  have  the  potential  of  producing  noninformative  intervals  for  N. 


CHAPTER  6 
CONCLUSIONS 


6.1     Summary  of  Results 

In  this  dissertation,  we  have  developed  methods  for  estimating  the  size  of  a  closed 
population  when  population  heterogeneity  exists  with  respect  to  a  subject's  propen- 
sity to  be  captured.  We  investigated  the  perfomance  of  mixture  models,  log-linear 
models,  and  a  latent  class  model  in  the  capture-recapture  setting  and  motivated  these 
models  in  such  a  way  as  to  explain  their  ability  to  accurately  estimate  the  population 
size  or  lack  thereof  for  a  variety  of  settings.  In  particular,  we  looked  at  situations 
when  population  heterogeneity  is  the  only  source  of  dependence  among  the  t  samples, 
situations  when  positive  or  negative  within-subject  dependence  exist,  and  situations 
when  both  sources  of  dependence  exist. 

We  found  that  the  continuous  mixture  models,  the  logistic-normal  model  assum- 
ing local  independence  and  the  mixed  serial  dependence  model,  provide  informative 
confidence  intervals  when  the  t  sampling  occasions  exhibit  a  weak  to  moderate  de- 
pendence structure  and  the  probability  of  capture  at  each  of  the  t  occasions  is  not 
small.  When  only  negative  associations  exist  among  the  t  sampling  occasions,  the 
logistic-normal  model,  or  any  other  generalized  linear  mixed  model  that  adds  a  ran- 
dom effect  for  each  subject,  will  not  accurately  estimate  N  since  this  random  effect 
cannot  describe  a  negative  dependence  structure.  When  strong  positive  associations 
exist  between  the  t  samples  and/or  the  probability  of  capture  at  each  of  the  occasions 
is  small,  these  mixed  models  have  the  disadvantage  of  incurring  flat  likelihoods  for 
N  that  lead  to  noninformative,  wide  confidence  intervals  for  N.  This  arises  from  the 
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near  nonidentifiability  problem  that  occurs  when  both  a  and  N  are  unknown.  This 
problem  occurs  since  a  can  be  thought  of  as  a  surrogate  for  7To...o,  the  probability  of 
being  in  the  unknown  cell.  If  we  consider  the  binomial  random  variable  with  success 
defined  as  being  observed  in  the  experiment,  this  near  nonidentifiability  problem  is 
the  same  one  experienced  in  the  i.i.d.  Binomial(./V,  p)  setting  when  N  and  p  are  both 
unknown. 

The  latent  class  model  often  provides  little  information  on  the  sample  size  because 
of  its  close  relationship  with  the  log-linear  model  of  quasi-symmetry,  which  provides 
no  information  on  N.  Simulation  studies  indicate  that  when  this  model  does  produce 
an  interval  estimate  for  N,  these  intervals  have  coverage  less  than  nominal  for  most 
conditions. 

The  simplest  log-linear  model,  the  log-linear  model  of  mutual  independence,  will 
not  estimate  N  accurately  if  there  exists  nonneglible  overall  dependencies,  positive  or 
negative,  among  the  t  samples.  However,  two  log-linear  models,  the  log-linear  model 
of  homogeneous  two-factor  interaction  and  the  log-linear  model  of  homogeneous  two- 
factor  interaction  plus  serial  dependence,  that  add  only  one  or  two  extra  parameters, 
respectively,  to  this  naive  model  produce  profile  likelihood  confidence  intervals  that 
maintain  coverage  probabilities  close  to  nominal  levels  under  a  wide  variety  of  de- 
pendence structures.  Unlike  the  logistic-normal  model,  these  intervals  can  describe 
negative  as  well  as  positive  associations  among  the  t  samples.  These  models  yield 
narrower  confidence  intervals  than  the  mixed  models  when  a  strong  positive  depen- 
dence structure  exists  among  the  t  samples  and/or  the  probability  of  capture  at  the 
t  occasions  is  small.  Some  might  argue  that  these  models  also  provide  little  informa- 
tion on  the  population  size  in  the  form  of  wide  interval  estimates,  but  in  light  of  the 
discussion  in  Section  5.4,  we  have  found  that  these  wide  intervals  are  more  realistic 
in  that  they  accurately  reflect  the  uncertainty  concerning  N  when  most  subjects  are 
captured  only  once.  The  Poisson  model  that  allows  for  overdispersion  in  Chapter  4 
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shows  promise  in  these  situations  in  that  it  provides  interval  estimates  that  are  wider 
than  the  mutual  independence  intervals  without  suffering  from  the  flat  log-likelihood 
surfaces  incurred  by  the  other  mixed  models.  In  applying  this  model  to  the  snow- 
shoe  hare  and  hepatitis  examples,  we  saw  evidence  that  this  model  complements  the 
logistic-normal  model  in  that  it  works  well  for  tables  exhibiting  large  amounts  of 
population  heterogeneity  and/or  small  probabilities  of  capture. 

We  also  compared  methods  for  constructing  interval  estimates  for  N.  Although  the 
bootstrap  is  probably  the  most  popular  method  in  the  capture-recapture  literature 
right  now,  we  gave  several  reasons  why  the  profile  likelihood  intervals  should  be 
preferred  when  used  in  conjunction  with  the  above  models.  First,  they  are  much 
easier  to  compute.  Secondly,  simulation  results  suggested  that  they  obtain  close- 
to  nominal  coverage.  One  might  argue  that  our  simulations  put  the  bootstrap  at 
an  unfair  advantage  since  we  used  a  theoretically  inferior  version  of  the  bootstrap 
with  few  resamples.  In  our  opinion,  however,  this  fact  further  demonstrates  our  first 
point.  We  used  these  crude  bootstrap  intervals  because  of  computational  constraints. 
One  must  make  a  large  computational  effort  just  to  make  the  bootstrap  competitive 
with  the  profile  likelihood  interval  by  either  computing  more  involved  versions  of  the 
bootstrap  (e.g.  BCa)  or  increasing  the  number  of  resamples.  Thirdly,  we  showed 
that  the  bootstrap  can  yield  misleading  narrow  confidence  intervals  for  N  even  when 
almost  all  possible  iV-values  are  essentially  equally  likely.  We  particularly  saw  this  in 
the  case  of  the  latent  class  model. 

Based  on  the  above  model  and  confidence  interval  comparisons,  we  recommended 
a  strategy  for  estimating  population  size  using  the  mixed  models  as  diagnostic  tools 
in  Section  5.5.  In  particular,  we  see  that  two  simple  log-linear  models  and  an  overdis- 
persed  Poisson  model  are  viable  alternatives  when  estimating  N  under  a  variety  of 
dependence  structures. 
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6.2    Future  Research 

Section  4.3  introduced  a  new  model,  the  multivariate  logit-normal  model,  that  al- 
lows for  negative  dependencies  between  t  binomial  responses.  It  would  be  of  interest 
to  investigate  the  properties  and  applications  of  this  model  further.  Specifically,  this 
binomial  model  has  the  disadvantage  relative  to  Aitchison  and  Ho's  (1989)  Poisson 
model  that  no  closed-form  expressions  exist  for  the  marginal  moments.  Approxima- 
tions to  the  logistic-normal  moments  that  work  well  for  a  large  range  of  an  would 
be  useful  in  this  regard.  We  also  noted  in  Section  4.3  that  this  model  can  only 
describe  certain  correlation  structures.  It  would  be  useful  to  determine  which  corre- 
lation structures  this  model  can  describe,  much  like  Section  4  of  Aitchison  and  Ho 
(1989)  does  for  the  Poisson  case.  In  terms  of  estimation,  it  is  well-known  that  for 
high-dimensional  random-effects,  Gaussian  quadrature  is  computationally  inefficient. 
We  saw  this  when  we  attempted  to  fit  the  model  for  t  >  3.  Perhaps  Monte  Carlo 
fitting  procedures  along  the  lines  of  Booth  and  Hobert  (1997)  would  be  useful  in 
making  this  model  more  practical.  If  so,  could  these  methods  be  extended  to  fit  the 
model  while  constraining  certain  parameters,  such  as  the  elements  in  the  mean  vector 
or  the  correlations,  to  be  equal? 

A  second  area  in  need  of  future  research  is  that  of  model  selection.  We  have  shown 
throughout  this  dissertation  that  traditional  goodness-of-fit  tests  have  limited  appli- 
cation in  this  extrapolation  problem,  forcing  the  statistician  to  rely  almost  completely 
on  the  researcher's  subject  matter  knowledge  to  make  informed  decisions  as  to  what 
statistical  assumptions  are  appropriate.  Recent  research  has  begun  to  incorporate 
model  uncertainty  into  inferences  made  on  N  through  model  averaging;  that  is,  an 
AT-estimate  is  obtained  by  taking  a  weighted  average  of  the  TV-estimates  from  several 
different  models,  the  weights  being  determined  from  the  data.  Madigan  and  York 
(1997)  used  Bayes  factors  with  simple  log-linear  models  as  the  basis  for  the  weights, 
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while  Buckland  et  al.  (1997)  proposed  a  simpler  method  based  on  information  cri- 
teria such  as  the  Akaike's  Information  Criterion  (AIC)  and  the  Bayes  Information 
Criterion  (BIC).  Both  of  these  criteria  are  based  on  the  log-likelihood,  which  we  have 
shown  does  not  necessarily  reflect  a  model's  ability  to  accurately  extrapolate  to  the 
missing  cell  count.  Thus,  future  research  as  to  which  of  these  methods,  if  any,  would 
be  effective  when  using  the  models  presented  here  could  possibly  be  fruitful. 

Finally,  the  performance  of  the  mixed  serial  dependence  model  relative  to  the 
logistic-normal  model  suggests  that  additional  model  structure  in  the  presence  of  a 
subject  random  effect  could  remove  the  near  nonidentifiability  problem  incurred  by 
these  mixed  models.  It  would  be  interesting  to  investigate  what  additional  model 
structure,  if  any,  could  alleviate  this  identifiability  problem  and  whether  this  ad- 
ditional structure  could  be  adapted  to  the  well-studied  i.i.d.  binomial  setting.  In 
particular,  the  incorporation  of  covariates  taken  on  captured  individuals  is  worthy  of 
special  attention. 
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